Sep 28 18:06:06 devstack cinder-volume[75628]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:06:06 devstack cinder-volume[75628]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:06:06 devstack cinder-volume[75628]: we strongly recommend against using it for new projects. Sep 28 18:06:06 devstack cinder-volume[75628]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:06:06 devstack cinder-volume[75628]: framework. For more detail see Sep 28 18:06:06 devstack cinder-volume[75628]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:06:06 devstack cinder-volume[75628]: import eventlet # noqa Sep 28 18:06:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:06:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:06:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:06:10 devstack cinder-volume[75628]: INFO dbcounter [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Registered counter for database cinder Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG oslo_db.sqlalchemy.engines [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writer thread running {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:06:10 devstack cinder-volume[75628]: INFO cinder.rpc [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:06:10 devstack cinder-volume[75628]: INFO cinder.rpc [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG oslo_db.sqlalchemy.engines [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:10 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Determined volume DB was empty at startup. Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75628) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:06:10 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:06:10 devstack cinder-volume[75628]: WARNING stevedore.named [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:06:10 devstack cinder-volume[75628]: WARNING castellan.key_manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:06:10 devstack cinder-volume[75628]: WARNING cinder.keymgr.conf_key_mgr [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75628) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 18:06:10 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] CMD "cinder-rtstool verify" returned: 0 in 0.474s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_db.sqlalchemy.engines [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:11 devstack cinder-volume[75628]: INFO cinder.rpc [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 18:06:11 devstack cinder-volume[75628]: INFO cinder.rpc [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 18:06:11 devstack cinder-volume[75628]: WARNING stevedore.named [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:06:11 devstack cinder-volume[75628]: WARNING castellan.key_manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:06:11 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_db.sqlalchemy.engines [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:11 devstack cinder-volume[75628]: INFO oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Starting 1 workers Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Started child 75784 {{(pid=75628) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Full set of CONF: {{(pid=75628) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] ******************************************************************************** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Configuration options gathered from: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] ================================================================================ {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] allow_availability_zone_fallback = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] allow_compression_on_image_upload = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75784]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] allowed_direct_url_schemes = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] api_rate_limit = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] auth_strategy = keystone {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] az_cache_duration = 3600 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_availability_zone = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_host = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_stats_polling_interval = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backup_api_class = cinder.backup.api.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backup_name_template = backup-%s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backup_use_same_host = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backup_use_temp_snapshot = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] chap_password = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] chap_username = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_internal_tenant_project_id = 6b73024960494d77aa2244cb1fbb255d {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_internal_tenant_user_id = f3ccbf711dda41138a08d4f8feff64ea {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cloned_volume_same_az = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cluster = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] compression_format = gzip {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] compute_api_class = cinder.compute.nova.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] config_dir = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] config_source = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] control_exchange = openstack {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] debug = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] default_availability_zone = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] default_group_type = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] default_volume_type = lvmdriver-1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] disk_geometry = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_client_cert = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_client_cert_key = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_data_namespace = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_ssl_cert_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_ssl_cert_verify = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] driver_use_ssl = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] enable_force_upload = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] enable_new_services = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] enable_unsupported_driver = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] enforce_multipath_for_image_xfer = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] filter_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_api_insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_api_ssl_compression = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_ca_certificates_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_catalog_info = image:glance:publicURL {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_num_retries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance_request_timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] goodness_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] graceful_shutdown_timeout = 5 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] group_api_class = cinder.group.api.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] host = devstack {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_compress_on_upload = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_conversion_address_space_limit = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_conversion_cpu_limit = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_conversion_disable = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_introspection_address_space_limit = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_introspection_cpu_limit = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_upload_use_cinder_backend = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_upload_use_internal_tenant = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_volume_cache_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_volume_cache_max_count = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] image_volume_cache_max_size_gb = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] init_host_max_objects_retrieval = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] instance_format = [instance: %(uuid)s] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iscsi_target_flags = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iscsi_write_cache = on {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iser_helper = tgtadm {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iser_ip_address = 192.168.122.247 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iser_port = 3260 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_color = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_config_append = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_dir = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_options = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_rotate_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_rotate_interval_type = days {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] log_rotation_type = none {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] max_age = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] max_logfile_count = 30 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] max_logfile_size_mb = 200 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] max_over_subscription_ratio = 20.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] message_reap_interval = 86400 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] message_ttl = 2592000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] migration_create_volume_timeout_secs = 300 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] monkey_patch = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] monkey_patch_modules = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] my_ip = 192.168.122.247 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] no_snapshot_gb_quota = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] num_iser_scan_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] num_shell_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] num_volume_device_scan_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] nvmeof_conn_info_version = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] nvmet_ns_id = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] nvmet_port_id = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_max_limit = 1000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_ext_list = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_listen_port = 8776 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_use_ssl = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] osapi_volume_workers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] per_volume_size_limit = -1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] periodic_fuzzy_delay = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] periodic_interval = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] public_endpoint = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] publish_errors = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_backup_gigabytes = 1000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_backups = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_gigabytes = 1000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_groups = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_snapshots = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] quota_volumes = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] rate_limit_burst = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] rate_limit_except_level = CRITICAL {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] rate_limit_interval = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] reinit_driver_count = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] replication_device = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] report_discard_supported = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] report_interval = 120 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] reservation_clean_interval = 86400 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] reservation_expire = 86400 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] reserved_image_namespaces = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] reserved_percentage = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] rpc_response_timeout = 120 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] run_external_periodic_tasks = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] scst_target_driver = iscsi {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] scst_target_iqn_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_down_time = 720 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] shell_completion = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] snapshot_name_template = snapshot-%s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] snapshot_same_host = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] split_loggers = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] state_path = /opt/stack/data/cinder {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] storage_availability_zone = nova {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] storage_protocol = iSCSI {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] syslog_log_facility = LOG_USER {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_helper = lioadm {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_ip_address = 192.168.122.247 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_port = 3260 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_protocol = iscsi {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] target_secondary_ip_addresses = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] trace_flags = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] transport_url = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] until_refresh = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_chap_auth = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_default_quota_class = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_journal = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_json = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_multipath_for_image_xfer = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_stderr = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] use_syslog = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] verify_glance_signatures = enabled {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_api_class = cinder.volume.api.API {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_backend_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_clear = zero {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_clear_ionice = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_clear_size = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_copy_bps_limit = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_dd_blocksize = 1M {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_name_template = volume-%s {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_service_inithost_offload = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volume_usage_audit_period = month {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] zoning_mode = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_concurrency.disable_process_locking = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.auth_section = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.auth_type = password {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.auth_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.cache = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.include_service_catalog = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.interface = public {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_password = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcache_username = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.region_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.service_type = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.backend = dogpile.cache.null {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.backend_argument = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.backend_expiration_time = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.config_prefix = cache.oslo {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.debug_cache_backend = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.enable_retry_client = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.enable_socket_keepalive = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.expiration_time = 600 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.hashclient_retry_attempts = 2 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_dead_retry = 300 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_pool_maxsize = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_sasl_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.password = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.proxies = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.redis_db = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.redis_server = localhost:6379 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.retry_attempts = 2 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.retry_delay = 0.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.socket_keepalive_count = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.socket_keepalive_idle = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.socket_keepalive_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.socket_timeout = 1.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.tls_allowed_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.tls_cafile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.tls_certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.tls_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.tls_keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cache.username = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] coordination.backend_url = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.asyncio_connection = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.asyncio_slave_connection = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.backend = sqlalchemy {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.connection = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.connection_debug = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.connection_parameters = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.connection_recycle_time = 3600 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.connection_trace = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.db_inc_retry_interval = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.db_max_retries = 20 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.db_max_retry_interval = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.db_retry_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.max_overflow = 50 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.max_pool_size = 5 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.max_retries = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.mysql_wsrep_sync_wait = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.pool_timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.retry_interval = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.slave_connection = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.sqlite_synchronous = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.synchronous_reader = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] database.use_db_reconnect = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack sudo[75817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_tracing.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack sudo[75817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.connection_string = messaging:// {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.es_doc_type = notification {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.es_scroll_size = 10000 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.es_scroll_time = 2m {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.filter_error_trace = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.hmac_keys = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.sentinel_service_name = mymaster {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.socket_timeout = 0.1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.trace_requests = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler.trace_sqlalchemy = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler_jaeger.process_tags = {} {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler_jaeger.service_name_prefix = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] profiler_otlp.service_name_prefix = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.enforce_new_defaults = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.policy_default_rule = default {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.policy_file = policy.yaml {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.group = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.helper_command = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] privsep_osbrick.user = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.group = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.helper_command = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] cinder_sys_admin.user = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.auth_section = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.auth_type = password {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.cafile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.collect_timing = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.send_service_user_token = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.split_loggers = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.tls_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] service_user.tls_min_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.auth_section = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.auth_type = password {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.collect_timing = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.region_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.split_loggers = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.tls_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] glance.tls_min_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.backend_availability_zone = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.chap_password = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.chap_username = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.disk_geometry = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_client_cert = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_client_cert_key = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_data_namespace = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.driver_use_ssl = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.extra_capabilities = {} {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.filter_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.goodness_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iscsi_target_flags = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iscsi_write_cache = on {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iser_helper = tgtadm {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iser_port = 3260 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.lvm_share_target = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.lvm_type = auto {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.num_shell_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.replication_device = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.report_discard_supported = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.reserved_percentage = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_helper = tgtadm {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_port = 3260 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_protocol = iscsi {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.trace_flags = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.unique_fqdn_network = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.use_chap_auth = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_backend_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_clear = zero {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_clear_ionice = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_clear_size = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_reports.file_event_handler = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_reports.log_dir = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.backend_host = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.chap_password = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.chap_username = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.disk_geometry = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_client_cert = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.extra_capabilities = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.filter_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.goodness_function = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iser_helper = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iser_ip_address = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iser_port = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.lvm_share_target = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.lvm_type = auto {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.num_shell_tries = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.replication_device = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.report_discard_supported = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.reserved_percentage = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.scst_target_driver = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.storage_protocol = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_helper = lioadm {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_ip_address = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_port = 3260 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.trace_flags = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.use_chap_auth = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_clear = zero {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_clear_size = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] lvmdriver-1.volumes_dir = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_notifications.driver = [] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_notifications.retry = -1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] key_manager.fixed_key = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.barbican_api_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.barbican_endpoint = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.barbican_endpoint_type = public {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.barbican_region_name = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.cafile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.collect_timing = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.number_of_retries = 60 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.retry_delay = 1 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.send_service_user_token = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.split_loggers = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.tls_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.tls_min_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.verify_ssl = True {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican.verify_ssl_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.auth_section = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.auth_type = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.cafile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.certfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.collect_timing = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.insecure = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.keyfile = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.split_loggers = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.timeout = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.tls_ciphers = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] barbican_service_user.tls_min_version = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.approle_role_id = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.approle_secret_id = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.auth_method = approle {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.auth_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.kv_mountpoint = secret {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.kv_path = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.kv_version = 2 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.namespace = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.root_token_id = **** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.ssl_ca_crt_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.timeout = 60.0 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.token_file = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.token_role = None {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.use_ssl = False {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:11 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] ******************************************************************************** {{(pid=75628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:06:12 devstack sudo[75817]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.393s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[75951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:12 devstack sudo[75951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:12 devstack sudo[75951]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.361s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:06:12 devstack cinder-volume[75784]: INFO cinder.brick.local_dev.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[76045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:12 devstack sudo[76045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:12 devstack sudo[76045]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG cinder.brick.local_dev.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75784) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 18:06:12 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[76132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:12 devstack sudo[76132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack sudo[76132]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[76317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:13 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 18:06:13 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.412s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[76485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:14 devstack sudo[76485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[76485]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[76488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:14 devstack sudo[76488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[76488]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:14 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:15 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.346s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[76584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:15 devstack sudo[76584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack sudo[76584]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.359s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[75784]: INFO cinder.volume.drivers.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:15 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:16 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.357s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:16 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:16 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:16 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:16 devstack sudo[76600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:16 devstack sudo[76600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:16 devstack sudo[76600]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:16 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:16 devstack sudo[76603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:16 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[76606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:17 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[75784]: INFO cinder.volume.driver [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG cinder.volume.driver [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75784) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG oslo_db.sqlalchemy.engines [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writer thread running {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG cinder.db.api [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Building query based on filter {{(pid=75784) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG cinder.image.image_utils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75784) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:06:17 devstack cinder-volume[75784]: INFO cinder.keymgr.migration [None req-db4ee557-8c0e-43ca-ad96-f9ec032efe82 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:06:17 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[76612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:17 devstack sudo[76612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack sudo[76612]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:18 devstack sudo[76615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:18 devstack sudo[76615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack sudo[76615]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:18 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:18 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:18 devstack sudo[76621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:18 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG cinder.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Notifying Schedulers of capabilities ... {{(pid=75784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:18 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Driver initialization completed successfully. Sep 28 18:06:18 devstack cinder-volume[75784]: INFO cinder.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Initiating service 2 cleanup Sep 28 18:06:18 devstack cinder-volume[75784]: INFO cinder.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Service 2 cleanup completed. Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG cinder.service [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Creating RPC server for service cinder-volume {{(pid=75784) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:06:18 devstack cinder-volume[75784]: DEBUG cinder.service [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75784) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:06:19 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack sudo[76627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:06:19 devstack sudo[76627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:19 devstack sudo[76627]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:19 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:19 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack sudo[76633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:06:19 devstack sudo[76633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:19 devstack sudo[76633]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:19 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:06:19 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:20 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:20 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:20 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-50594888-08d4-4207-86ee-482ec2e509ff None None] Driver post RPC initialization completed successfully. Sep 28 18:06:21 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:SELECT=3 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:33 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager._thread_info {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:33 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread count: 6 {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:06:33 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread info: [<_MainThread(MainThread, started 139080902418560)>, , , , , ] {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:33 devstack sudo[78881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:07:33 devstack sudo[78881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:33 devstack sudo[78881]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:33 devstack sudo[78884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:07:33 devstack sudo[78884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:33 devstack sudo[78884]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:33 devstack sudo[78903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:07:33 devstack sudo[78903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:34 devstack sudo[78903]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:34 devstack sudo[78907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:07:34 devstack sudo[78907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:34 devstack sudo[78907]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG cinder.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Notifying Schedulers of capabilities ... {{(pid=75784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager._thread_info {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread count: 6 {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:07:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread info: [<_MainThread(MainThread, started 139080902418560)>, , , , , ] {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:08:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:SELECT=1 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:UPDATE=1 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:33 devstack sudo[81966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:08:33 devstack sudo[81966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:33 devstack sudo[81966]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:33 devstack sudo[81969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:08:33 devstack sudo[81969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:33 devstack sudo[81969]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:33 devstack sudo[81977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:08:33 devstack sudo[81977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:34 devstack sudo[81977]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:34 devstack sudo[81981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:08:34 devstack sudo[81981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:34 devstack sudo[81981]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG cinder.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Notifying Schedulers of capabilities ... {{(pid=75784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager._thread_info {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread count: 6 {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:08:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread info: [<_MainThread(MainThread, started 139080902418560)>, , , , , ] {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[83933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:09:33 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:33 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:09:33 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:33 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[83944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:09:33 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:34 devstack sudo[83951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:09:34 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG cinder.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Notifying Schedulers of capabilities ... {{(pid=75784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager._thread_info {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread count: 6 {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:09:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread info: [<_MainThread(MainThread, started 139080902418560)>, , , , , ] {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:10:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:SELECT=1 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:30 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:UPDATE=1 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Updating volume stats {{(pid=75784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:10:33 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:10:33 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:33 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:10:33 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:34 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:10:34 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG cinder.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Notifying Schedulers of capabilities ... {{(pid=75784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG oslo_service.periodic_task [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] Running periodic task VolumeManager._thread_info {{(pid=75784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread count: 6 {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:10:34 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-f80123a8-afab-4113-9db0-0df7c7e9ac2e None None] thread info: [<_MainThread(MainThread, started 139080902418560)>, , , , , ] {{(pid=75784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:11:09 devstack cinder-volume[75628]: INFO oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Caught SIGTERM, stopping children Sep 28 18:11:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Acquiring lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Acquired lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Releasing lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:09 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Stop services. {{(pid=75628) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:11:09 devstack cinder-volume[75628]: DEBUG oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Killing children. {{(pid=75628) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:11:09 devstack cinder-volume[75628]: INFO oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Waiting on 1 children to exit Sep 28 18:11:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Acquiring lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Acquired lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:14 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Releasing lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:14 devstack cinder-volume[75784]: WARNING amqp [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:11:14 devstack cinder-volume[75784]: WARNING amqp [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:11:14 devstack cinder-volume[75628]: INFO oslo_service.backend._eventlet.service [None req-84558a56-c7c5-4758-80e0-144d863e5d67 None None] Child 75784 exited with status 0 Sep 28 18:11:14 devstack cinder-volume[85808]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:11:14 devstack cinder-volume[85808]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:11:14 devstack cinder-volume[85808]: we strongly recommend against using it for new projects. Sep 28 18:11:14 devstack cinder-volume[85808]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:11:14 devstack cinder-volume[85808]: framework. For more detail see Sep 28 18:11:14 devstack cinder-volume[85808]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:11:14 devstack cinder-volume[85808]: import eventlet # noqa Sep 28 18:11:17 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:17 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:17 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:17 devstack cinder-volume[85808]: INFO dbcounter [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Registered counter for database cinder Sep 28 18:11:17 devstack cinder-volume[85808]: DEBUG oslo_db.sqlalchemy.engines [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85808) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG dbcounter [-] [85808] Writer thread running {{(pid=85808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:11:18 devstack cinder-volume[85808]: INFO cinder.rpc [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:11:18 devstack cinder-volume[85808]: INFO cinder.rpc [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_db.sqlalchemy.engines [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85808) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:18 devstack cinder-volume[85808]: INFO cinder.volume.manager [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Determined volume DB was empty at startup. Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG cinder.volume.manager [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85808) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:11:18 devstack cinder-volume[85808]: INFO cinder.volume.manager [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:11:18 devstack cinder-volume[85808]: WARNING stevedore.named [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:11:18 devstack cinder-volume[85808]: WARNING castellan.key_manager [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:11:18 devstack cinder-volume[85808]: WARNING cinder.keymgr.conf_key_mgr [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:11:18 devstack cinder-volume[85808]: INFO cinder.volume.manager [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_db.sqlalchemy.engines [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85808) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:18 devstack cinder-volume[85808]: INFO oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Starting 1 workers Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Started child 86028 {{(pid=85808) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Full set of CONF: {{(pid=85808) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] ******************************************************************************** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Configuration options gathered from: {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] ================================================================================ {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:11:18 devstack cinder-volume[86028]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] allow_availability_zone_fallback = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] allow_compression_on_image_upload = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] allowed_direct_url_schemes = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] api_rate_limit = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] auth_strategy = keystone {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_availability_zone = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_host = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_stats_polling_interval = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backup_api_class = cinder.backup.api.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backup_name_template = backup-%s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backup_use_same_host = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backup_use_temp_snapshot = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] chap_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] chap_username = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_internal_tenant_project_id = 6b73024960494d77aa2244cb1fbb255d {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_internal_tenant_user_id = f3ccbf711dda41138a08d4f8feff64ea {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cluster = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] compression_format = gzip {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] compute_api_class = cinder.compute.nova.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] config_dir = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] config_source = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] control_exchange = openstack {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] debug = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] default_availability_zone = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] default_group_type = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] default_volume_type = QuobyteHD {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] disk_geometry = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_client_cert = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_client_cert_key = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_data_namespace = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_ssl_cert_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_ssl_cert_verify = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] driver_use_ssl = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] enable_new_services = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] enable_unsupported_driver = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] enabled_backends = ['QuobyteHD'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] enforce_multipath_for_image_xfer = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] filter_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_api_insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_api_ssl_compression = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_ca_certificates_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_catalog_info = image:glance:publicURL {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_num_retries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance_request_timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] goodness_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] graceful_shutdown_timeout = 5 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] group_api_class = cinder.group.api.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] host = devstack {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_compress_on_upload = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_conversion_address_space_limit = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_conversion_cpu_limit = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_conversion_disable = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_introspection_address_space_limit = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_introspection_cpu_limit = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_upload_use_cinder_backend = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_upload_use_internal_tenant = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_volume_cache_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_volume_cache_max_count = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] image_volume_cache_max_size_gb = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] init_host_max_objects_retrieval = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] instance_format = [instance: %(uuid)s] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iscsi_target_flags = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iscsi_write_cache = on {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iser_helper = tgtadm {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iser_ip_address = 192.168.122.247 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iser_port = 3260 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86028) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_color = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_config_append = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_dir = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_options = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_rotate_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_rotate_interval_type = days {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] log_rotation_type = none {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] max_age = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] max_logfile_count = 30 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] max_logfile_size_mb = 200 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] max_over_subscription_ratio = 20.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] message_reap_interval = 86400 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] message_ttl = 2592000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] migration_create_volume_timeout_secs = 300 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] monkey_patch = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] monkey_patch_modules = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] my_ip = 192.168.122.247 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] no_snapshot_gb_quota = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] num_iser_scan_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] num_shell_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] num_volume_device_scan_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] nvmeof_conn_info_version = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] nvmet_ns_id = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] nvmet_port_id = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_max_limit = 1000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_ext_list = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_listen_port = 8776 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_use_ssl = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] osapi_volume_workers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] per_volume_size_limit = -1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] periodic_fuzzy_delay = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] periodic_interval = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] public_endpoint = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] publish_errors = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_backup_gigabytes = 1000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_backups = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_gigabytes = 1000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_groups = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_snapshots = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] quota_volumes = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] rate_limit_burst = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] rate_limit_except_level = CRITICAL {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] rate_limit_interval = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] reinit_driver_count = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] replication_device = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] report_discard_supported = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] report_interval = 120 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] reservation_clean_interval = 86400 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] reservation_expire = 86400 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] reserved_image_namespaces = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] reserved_percentage = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] rpc_response_timeout = 120 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] run_external_periodic_tasks = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] scst_target_driver = iscsi {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] scst_target_iqn_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_down_time = 720 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] shell_completion = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] snapshot_name_template = snapshot-%s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] split_loggers = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] state_path = /opt/stack/data/cinder {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] storage_availability_zone = nova {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] storage_protocol = iSCSI {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] syslog_log_facility = LOG_USER {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_helper = lioadm {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_ip_address = 192.168.122.247 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_port = 3260 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_protocol = iscsi {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] target_secondary_ip_addresses = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] trace_flags = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] transport_url = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] until_refresh = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_chap_auth = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_default_quota_class = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_journal = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_json = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_multipath_for_image_xfer = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_stderr = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] use_syslog = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] verify_glance_signatures = enabled {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_api_class = cinder.volume.api.API {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_backend_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_clear = zero {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_clear_ionice = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_clear_size = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_copy_bps_limit = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_dd_blocksize = 1M {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_name_template = volume-%s {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_service_inithost_offload = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volume_usage_audit_period = month {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] zoning_mode = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_concurrency.disable_process_locking = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.auth_section = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.auth_type = password {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86028) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.auth_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.cache = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.include_service_catalog = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.interface = public {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Running cmd (subprocess): mount.quobyte {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcache_username = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.region_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.service_type = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.backend = dogpile.cache.null {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.backend_argument = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.backend_expiration_time = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.config_prefix = cache.oslo {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.debug_cache_backend = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.enable_retry_client = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.enable_socket_keepalive = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.expiration_time = 600 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.hashclient_retry_attempts = 2 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_dead_retry = 300 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_pool_maxsize = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_sasl_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.proxies = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.redis_db = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.redis_server = localhost:6379 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.retry_attempts = 2 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.retry_delay = 0.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.socket_keepalive_count = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.socket_keepalive_idle = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.socket_keepalive_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.socket_timeout = 1.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.tls_allowed_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.tls_cafile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.tls_certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.tls_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.tls_keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cache.username = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] coordination.backend_url = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.asyncio_connection = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.asyncio_slave_connection = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.backend = sqlalchemy {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.connection = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.connection_debug = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.connection_parameters = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.connection_recycle_time = 3600 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.connection_trace = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.db_inc_retry_interval = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.db_max_retries = 20 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.db_max_retry_interval = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.db_retry_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.max_overflow = 50 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.max_pool_size = 5 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.max_retries = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.mysql_wsrep_sync_wait = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.pool_timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.retry_interval = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.slave_connection = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.sqlite_synchronous = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.synchronous_reader = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] database.use_db_reconnect = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_tracing.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.connection_string = messaging:// {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.es_doc_type = notification {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.es_scroll_size = 10000 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.es_scroll_time = 2m {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.filter_error_trace = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.hmac_keys = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.sentinel_service_name = mymaster {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.socket_timeout = 0.1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.trace_requests = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler.trace_sqlalchemy = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler_jaeger.process_tags = {} {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler_jaeger.service_name_prefix = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] profiler_otlp.service_name_prefix = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.enforce_new_defaults = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.policy_default_rule = default {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.policy_file = policy.yaml {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.group = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.helper_command = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] privsep_osbrick.user = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.group = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.helper_command = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] cinder_sys_admin.user = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.auth_section = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.auth_type = password {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.cafile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.collect_timing = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.send_service_user_token = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.split_loggers = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.tls_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] service_user.tls_min_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.auth_section = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.auth_type = password {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.collect_timing = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.region_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.split_loggers = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.tls_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] glance.tls_min_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.backend_availability_zone = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.chap_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.chap_username = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.disk_geometry = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_client_cert = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_client_cert_key = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_data_namespace = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.driver_use_ssl = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.extra_capabilities = {} {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.filter_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.goodness_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iscsi_target_flags = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iscsi_write_cache = on {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iser_helper = tgtadm {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iser_port = 3260 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_host = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_login = admin {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_mount_options = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_private_key = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_share_path = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.num_shell_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.quobyte_volume_url = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.replication_device = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.report_discard_supported = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.reserved_percentage = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_helper = tgtadm {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_port = 3260 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_protocol = iscsi {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.trace_flags = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.unique_fqdn_network = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.use_chap_auth = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_backend_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_clear = zero {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_clear_ionice = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_clear_size = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_reports.file_event_handler = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_reports.log_dir = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.backend_availability_zone = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.backend_host = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.chap_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.chap_username = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack quobyte-client[86029]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:11:18 devstack quobyte-client[86029]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.chiscsi_conf = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.disk_geometry = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_client_cert = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_data_namespace = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.driver_use_ssl = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.extra_capabilities = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.filter_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.goodness_function = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iser_helper = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iser_ip_address = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iser_port = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.iser_target_prefix = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_host = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_login = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_mount_options = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_password = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_private_key = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_share_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_ssh_port = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.num_shell_tries = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.nvmet_port_id = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.replication_device = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.report_discard_supported = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.reserved_percentage = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.scst_target_driver = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.storage_protocol = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_helper = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: INFO cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 ... Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_ip_address = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 -c /etc/quobyte/client-cinder.cfg {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_port = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_prefix = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_protocol = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.trace_flags = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.use_chap_auth = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_clear = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_clear_size = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] QuobyteHD.volumes_dir = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_notifications.driver = [] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_notifications.retry = -1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] key_manager.fixed_key = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.barbican_api_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.barbican_endpoint = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.barbican_endpoint_type = public {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.barbican_region_name = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.cafile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.collect_timing = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.number_of_retries = 60 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.retry_delay = 1 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.send_service_user_token = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.split_loggers = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.tls_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.tls_min_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.verify_ssl = True {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican.verify_ssl_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.auth_section = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.auth_type = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.cafile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.certfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.collect_timing = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.insecure = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.keyfile = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.split_loggers = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.timeout = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.tls_ciphers = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] barbican_service_user.tls_min_version = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.approle_role_id = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.approle_secret_id = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.auth_method = approle {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.auth_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.kv_mountpoint = secret {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.kv_path = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.kv_version = 2 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.namespace = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.root_token_id = **** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.ssl_ca_crt_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.timeout = 60.0 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.token_file = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.token_role = None {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.use_ssl = False {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:18 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] ******************************************************************************** {{(pid=85808) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:11:18 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 -c /etc/quobyte/client-cinder.cfg Sep 28 18:11:18 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:19 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.527s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:19 devstack cinder-volume[86028]: INFO cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 succeeded Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.549s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:19 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:19 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:19 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.331s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:19 devstack cinder-volume[86028]: INFO cinder.volume.driver [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG cinder.volume.driver [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0108604431152, 'free_capacity_gb': 1775.0108604431152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG oslo_db.sqlalchemy.engines [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:19 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writer thread running {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.db.api [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Building query based on filter {{(pid=86028) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86028) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:11:20 devstack cinder-volume[86028]: INFO cinder.keymgr.migration [None req-017ea979-7ed3-42c1-99d1-bf0aa2664260 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:20 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:20 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:20 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Driver initialization completed successfully. Sep 28 18:11:20 devstack cinder-volume[86028]: INFO cinder.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Initiating service 3 cleanup Sep 28 18:11:20 devstack cinder-volume[86028]: INFO cinder.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Service 3 cleanup completed. Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.service [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Creating RPC server for service cinder-volume {{(pid=86028) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.service [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86028) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:11:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:20 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:20 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:21 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.335s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe666d79-ddc1-4b60-bbb7-45644481d90b None None] Driver post RPC initialization completed successfully. Sep 28 18:11:24 devstack cinder-volume[85808]: INFO oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Caught SIGTERM, stopping children Sep 28 18:11:24 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Acquiring lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:24 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Acquired lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:24 devstack cinder-volume[85808]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Releasing lock "singleton_lock" {{(pid=85808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:24 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Stop services. {{(pid=85808) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:11:24 devstack cinder-volume[85808]: DEBUG oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Killing children. {{(pid=85808) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:11:24 devstack cinder-volume[85808]: INFO oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Waiting on 1 children to exit Sep 28 18:11:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Acquiring lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Acquired lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Releasing lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:25 devstack cinder-volume[86028]: WARNING amqp [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:11:25 devstack cinder-volume[86028]: WARNING amqp [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:11:25 devstack cinder-volume[85808]: INFO oslo_service.backend._eventlet.service [None req-c8cde7ad-e7a3-4c7d-a418-f65bdf328486 None None] Child 86028 exited with status 0 Sep 28 18:11:25 devstack cinder-volume[86332]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:11:25 devstack cinder-volume[86332]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:11:25 devstack cinder-volume[86332]: we strongly recommend against using it for new projects. Sep 28 18:11:25 devstack cinder-volume[86332]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:11:25 devstack cinder-volume[86332]: framework. For more detail see Sep 28 18:11:25 devstack cinder-volume[86332]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:11:25 devstack cinder-volume[86332]: import eventlet # noqa Sep 28 18:11:29 devstack cinder-volume[86332]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:11:29 devstack cinder-volume[86332]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:11:29 devstack cinder-volume[86332]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:11:30 devstack cinder-volume[86332]: INFO dbcounter [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Registered counter for database cinder Sep 28 18:11:30 devstack cinder-volume[86332]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:30 devstack cinder-volume[86332]: DEBUG dbcounter [-] [86332] Writer thread running {{(pid=86332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:11:30 devstack cinder-volume[86332]: INFO cinder.rpc [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:11:30 devstack cinder-volume[86332]: INFO cinder.rpc [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:31 devstack cinder-volume[86332]: INFO cinder.volume.manager [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Determined volume DB was empty at startup. Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG cinder.volume.manager [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86332) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:11:31 devstack cinder-volume[86332]: WARNING stevedore.named [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:11:31 devstack cinder-volume[86332]: WARNING castellan.key_manager [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:11:31 devstack cinder-volume[86332]: WARNING cinder.keymgr.conf_key_mgr [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:11:31 devstack cinder-volume[86332]: INFO cinder.volume.manager [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:31 devstack cinder-volume[86332]: INFO oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Starting 1 workers Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Started child 86560 {{(pid=86332) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Full set of CONF: {{(pid=86332) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] ******************************************************************************** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] Configuration options gathered from: {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:11:31 devstack cinder-volume[86560]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] ================================================================================ {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] allow_availability_zone_fallback = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] allow_compression_on_image_upload = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] allowed_direct_url_schemes = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] api_rate_limit = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] auth_strategy = keystone {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_availability_zone = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_host = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_stats_polling_interval = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backup_api_class = cinder.backup.api.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backup_name_template = backup-%s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backup_use_same_host = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backup_use_temp_snapshot = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] chap_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] chap_username = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_internal_tenant_project_id = 6b73024960494d77aa2244cb1fbb255d {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_internal_tenant_user_id = f3ccbf711dda41138a08d4f8feff64ea {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cluster = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] compression_format = gzip {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] compute_api_class = cinder.compute.nova.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] config_dir = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] config_source = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] control_exchange = openstack {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] debug = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] default_availability_zone = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] default_group_type = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] default_volume_type = QuobyteHD {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] disk_geometry = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_client_cert = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_client_cert_key = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_data_namespace = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_ssl_cert_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_ssl_cert_verify = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] driver_use_ssl = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] enable_new_services = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] enable_unsupported_driver = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] enabled_backends = ['QuobyteHD'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] enforce_multipath_for_image_xfer = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] filter_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_api_insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_api_servers = ['http://192.168.122.247/image'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_api_ssl_compression = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_ca_certificates_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_catalog_info = image:glance:publicURL {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_num_retries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance_request_timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] goodness_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86560) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] graceful_shutdown_timeout = 5 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] group_api_class = cinder.group.api.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] host = devstack {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_compress_on_upload = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_conversion_address_space_limit = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_conversion_cpu_limit = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_conversion_disable = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_introspection_address_space_limit = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_introspection_cpu_limit = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_upload_use_cinder_backend = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_upload_use_internal_tenant = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_volume_cache_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_volume_cache_max_count = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] image_volume_cache_max_size_gb = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] init_host_max_objects_retrieval = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] instance_format = [instance: %(uuid)s] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iscsi_target_flags = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iscsi_write_cache = on {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iser_helper = tgtadm {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iser_ip_address = 192.168.122.247 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iser_port = 3260 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_color = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_config_append = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_dir = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_options = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_rotate_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_rotate_interval_type = days {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] log_rotation_type = none {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] max_age = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] max_logfile_count = 30 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] max_logfile_size_mb = 200 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] max_over_subscription_ratio = 20.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] message_reap_interval = 86400 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] message_ttl = 2592000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] migration_create_volume_timeout_secs = 300 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] monkey_patch = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] monkey_patch_modules = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] my_ip = 192.168.122.247 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] no_snapshot_gb_quota = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] num_iser_scan_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] num_shell_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] num_volume_device_scan_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] nvmeof_conn_info_version = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] nvmet_ns_id = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] nvmet_port_id = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_max_limit = 1000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_ext_list = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_listen_port = 8776 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_use_ssl = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] osapi_volume_workers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] per_volume_size_limit = -1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] periodic_fuzzy_delay = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] periodic_interval = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] public_endpoint = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] publish_errors = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_backup_gigabytes = 1000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_backups = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_gigabytes = 1000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_groups = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_snapshots = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] quota_volumes = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] rate_limit_burst = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] rate_limit_except_level = CRITICAL {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] rate_limit_interval = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] reinit_driver_count = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] replication_device = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] report_discard_supported = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] report_interval = 120 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] reservation_clean_interval = 86400 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] reservation_expire = 86400 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] reserved_image_namespaces = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] reserved_percentage = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] rpc_response_timeout = 120 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] run_external_periodic_tasks = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] scst_target_driver = iscsi {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] scst_target_iqn_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_down_time = 720 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] shell_completion = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] snapshot_name_template = snapshot-%s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] split_loggers = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] state_path = /opt/stack/data/cinder {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] storage_availability_zone = nova {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] storage_protocol = iSCSI {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] syslog_log_facility = LOG_USER {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_helper = lioadm {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_ip_address = 192.168.122.247 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_port = 3260 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_protocol = iscsi {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] target_secondary_ip_addresses = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] trace_flags = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] transport_url = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] until_refresh = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_chap_auth = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_default_quota_class = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_journal = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_json = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_multipath_for_image_xfer = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_stderr = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] use_syslog = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] verify_glance_signatures = enabled {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_api_class = cinder.volume.api.API {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_backend_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_clear = zero {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_clear_ionice = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_clear_size = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_copy_bps_limit = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_dd_blocksize = 1M {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_name_template = volume-%s {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_service_inithost_offload = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volume_usage_audit_period = month {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] zoning_mode = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_concurrency.disable_process_locking = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.auth_section = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.auth_type = password {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.auth_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.cache = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.include_service_catalog = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.interface = public {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcache_username = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.region_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.service_type = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.backend = dogpile.cache.null {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.backend_argument = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.backend_expiration_time = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.config_prefix = cache.oslo {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.debug_cache_backend = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.enable_retry_client = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.enable_socket_keepalive = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.expiration_time = 600 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.hashclient_retry_attempts = 2 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_dead_retry = 300 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_pool_maxsize = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_sasl_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.proxies = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.redis_db = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.redis_server = localhost:6379 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.retry_attempts = 2 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.retry_delay = 0.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.socket_keepalive_count = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.socket_keepalive_idle = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.socket_keepalive_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.socket_timeout = 1.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.tls_allowed_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.tls_cafile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.tls_certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.tls_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.tls_keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cache.username = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] coordination.backend_url = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.asyncio_connection = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.asyncio_slave_connection = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.backend = sqlalchemy {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.connection = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.connection_debug = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.connection_parameters = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.connection_recycle_time = 3600 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.connection_trace = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.db_inc_retry_interval = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.db_max_retries = 20 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.db_max_retry_interval = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.db_retry_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.max_overflow = 50 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.max_pool_size = 5 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.max_retries = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.mysql_wsrep_sync_wait = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.pool_timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.retry_interval = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.slave_connection = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.sqlite_synchronous = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.synchronous_reader = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] database.use_db_reconnect = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_tracing.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.connection_string = messaging:// {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.es_doc_type = notification {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.es_scroll_size = 10000 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.es_scroll_time = 2m {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.filter_error_trace = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.hmac_keys = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.sentinel_service_name = mymaster {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.socket_timeout = 0.1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.trace_requests = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler.trace_sqlalchemy = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler_jaeger.process_tags = {} {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler_jaeger.service_name_prefix = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] profiler_otlp.service_name_prefix = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.enforce_new_defaults = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.policy_default_rule = default {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.policy_file = policy.yaml {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86560) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.group = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.helper_command = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] privsep_osbrick.user = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Running cmd (subprocess): mount.quobyte {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.group = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.helper_command = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] cinder_sys_admin.user = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.auth_section = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.auth_type = password {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.cafile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.collect_timing = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.send_service_user_token = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.split_loggers = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.tls_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] service_user.tls_min_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.auth_section = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.auth_type = password {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.collect_timing = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.region_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.split_loggers = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.tls_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] glance.tls_min_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.backend_availability_zone = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.chap_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.chap_username = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.disk_geometry = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_client_cert = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_client_cert_key = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_data_namespace = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.driver_use_ssl = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.extra_capabilities = {} {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.filter_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.goodness_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iscsi_target_flags = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iscsi_write_cache = on {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iser_helper = tgtadm {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iser_port = 3260 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_host = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_login = admin {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_mount_options = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_private_key = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_share_path = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.num_shell_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.quobyte_volume_url = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.replication_device = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.report_discard_supported = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.reserved_percentage = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_helper = tgtadm {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_port = 3260 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_protocol = iscsi {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.trace_flags = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.unique_fqdn_network = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.use_chap_auth = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_backend_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_clear = zero {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_clear_ionice = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_clear_size = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_reports.file_event_handler = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_reports.log_dir = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.backend_availability_zone = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.backend_host = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.chap_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.chap_username = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.chiscsi_conf = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.disk_geometry = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_client_cert = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_data_namespace = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.driver_use_ssl = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.extra_capabilities = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.filter_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.goodness_function = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iser_helper = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iser_ip_address = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iser_port = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.iser_target_prefix = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_host = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_login = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_mount_options = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_password = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_private_key = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_share_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_ssh_port = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.num_shell_tries = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.nvmet_port_id = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.replication_device = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.report_discard_supported = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.reserved_percentage = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.scst_target_driver = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.storage_protocol = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_helper = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_ip_address = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_port = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_prefix = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_protocol = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.trace_flags = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.use_chap_auth = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_clear = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_clear_size = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] QuobyteHD.volumes_dir = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack quobyte-client[86584]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:11:31 devstack quobyte-client[86584]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_notifications.driver = [] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_notifications.retry = -1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] key_manager.fixed_key = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.barbican_api_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.barbican_endpoint = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.barbican_endpoint_type = public {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.barbican_region_name = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.cafile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.collect_timing = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.number_of_retries = 60 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.retry_delay = 1 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.send_service_user_token = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.split_loggers = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.tls_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.tls_min_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.verify_ssl = True {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican.verify_ssl_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.auth_section = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.auth_type = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.cafile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.certfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.collect_timing = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.insecure = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.keyfile = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.split_loggers = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.timeout = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.tls_ciphers = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] barbican_service_user.tls_min_version = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.approle_role_id = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.approle_secret_id = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.auth_method = approle {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.auth_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.kv_mountpoint = secret {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.kv_path = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.kv_version = 2 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.namespace = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.root_token_id = **** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.ssl_ca_crt_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.timeout = 60.0 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.token_file = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.token_role = None {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.use_ssl = False {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:11:31 devstack cinder-volume[86332]: DEBUG oslo_service.backend._eventlet.service [None req-4fa5f82b-1cdf-49f1-acb6-a2b5b0d98e80 None None] ******************************************************************************** {{(pid=86332) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:11:31 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:31 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:31 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:31 devstack cinder-volume[86560]: INFO cinder.volume.driver [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:11:31 devstack cinder-volume[86560]: DEBUG cinder.volume.driver [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9874877929688, 'free_capacity_gb': 1774.9874877929688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86560) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_db.sqlalchemy.engines [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writer thread running {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.db.api [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Building query based on filter {{(pid=86560) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86560) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:32 devstack cinder-volume[86560]: INFO cinder.keymgr.migration [None req-01b1b411-a3ac-41e4-b8e5-12584d5358bf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:11:32 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:32 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:32 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.385s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Driver initialization completed successfully. Sep 28 18:11:32 devstack cinder-volume[86560]: INFO cinder.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Initiating service 3 cleanup Sep 28 18:11:32 devstack cinder-volume[86560]: INFO cinder.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Service 3 cleanup completed. Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.service [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Creating RPC server for service cinder-volume {{(pid=86560) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.service [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86560) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:11:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:32 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:11:32 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:33 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.280s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f233fe97-5e08-4f93-8be5-8accb9a1713f None None] Driver post RPC initialization completed successfully. Sep 28 18:11:41 devstack cinder-volume[86332]: DEBUG dbcounter [-] [86332] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:42 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:43 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 6 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:12:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Flow 'volume_create_manager' (8af24806-5677-4f0d-92cc-99a54d42f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491e6a49-82e2-48eb-8580-156d6e8ebba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491e6a49-82e2-48eb-8580-156d6e8ebba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-404028760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dab453-d5aa-419e-a4e8-71b32a96445b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b9105a48f44457941280f4dcb786ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:40Z,use_quota=True,user_id='2763034a9c0946c2b7501a541f782c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655fc62-c792-4753-89db-9253ed717a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655fc62-c792-4753-89db-9253ed717a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eeb7e8-6528-46f8-a2b1-df0baf2fc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eeb7e8-6528-46f8-a2b1-df0baf2fc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15dab453-d5aa-419e-a4e8-71b32a96445b', 'volume_name': 'volume-15dab453-d5aa-419e-a4e8-71b32a96445b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bed44bb-62af-4b7b-a717-33f3b513ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bed44bb-62af-4b7b-a717-33f3b513ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd9630-e4b9-4e4b-becd-b8777c967e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Volume 15dab453-d5aa-419e-a4e8-71b32a96445b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15dab453-d5aa-419e-a4e8-71b32a96445b', 'volume_size': 1} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-404028760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dab453-d5aa-419e-a4e8-71b32a96445b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b9105a48f44457941280f4dcb786ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:40Z,use_quota=True,user_id='2763034a9c0946c2b7501a541f782c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Creating volume 15dab453-d5aa-419e-a4e8-71b32a96445b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:40 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b 1073741824 Sep 28 18:12:40 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:40 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b 1073741824" returned: 0 in 0.815s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b Sep 28 18:12:40 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd9630-e4b9-4e4b-becd-b8777c967e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15dab453-d5aa-419e-a4e8-71b32a96445b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b443d8-a129-49a4-9fc1-672f361df552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Volume volume-15dab453-d5aa-419e-a4e8-71b32a96445b (15dab453-d5aa-419e-a4e8-71b32a96445b): created successfully Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b443d8-a129-49a4-9fc1-672f361df552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Flow 'volume_create_manager' (8af24806-5677-4f0d-92cc-99a54d42f006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6fffdaf6-ace4-4685-9f69-34452cc2fc83 tempest-TaggedAttachmentsTest-436060271 None] Created volume successfully. Sep 28 18:12:51 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:51 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:13:00 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 1.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:01 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 6 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:13:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Flow 'volume_create_manager' (d1668b5a-8a50-4abf-a6a0-367b8a8139a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef25ee3-67fa-4b91-bf28-c13e38227152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef25ee3-67fa-4b91-bf28-c13e38227152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-9933817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b041f3-32b4-40c7-8063-b2a9dff1cd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72fbfb264fd4579bcfe748dae4e583f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:28Z,use_quota=True,user_id='f0e3ed0821df4b7087f2bbcf0cd19bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9e5227-0cb1-4bee-9b3a-aa226fcace52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9e5227-0cb1-4bee-9b3a-aa226fcace52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe065e2f-4eb4-41ef-92f7-1851bde1a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe065e2f-4eb4-41ef-92f7-1851bde1a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b041f3-32b4-40c7-8063-b2a9dff1cd9f', 'volume_name': 'volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8292952-9d85-4564-9855-831b77ede36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8292952-9d85-4564-9855-831b77ede36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f507b60-5d90-4a2e-acc3-f0f7ce70ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Volume 91b041f3-32b4-40c7-8063-b2a9dff1cd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f', 'volume_size': 1} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-9933817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b041f3-32b4-40c7-8063-b2a9dff1cd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72fbfb264fd4579bcfe748dae4e583f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:28Z,use_quota=True,user_id='f0e3ed0821df4b7087f2bbcf0cd19bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Creating volume 91b041f3-32b4-40c7-8063-b2a9dff1cd9f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:28 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:28 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f 1073741824 Sep 28 18:13:28 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:28 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f 1073741824" returned: 0 in 0.729s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:29 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f Sep 28 18:13:29 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f507b60-5d90-4a2e-acc3-f0f7ce70ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5ddb6b-221f-4e0f-946d-58b65aabd82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Volume volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f (91b041f3-32b4-40c7-8063-b2a9dff1cd9f): created successfully Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5ddb6b-221f-4e0f-946d-58b65aabd82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Flow 'volume_create_manager' (d1668b5a-8a50-4abf-a6a0-367b8a8139a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6f7f3ff4-821d-4fe4-ad70-cab718e8a704 tempest-ServerRescueNegativeTestJSON-1462396131 None] Created volume successfully. Sep 28 18:13:39 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:43 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Acquiring lock "cinder-91b041f3-32b4-40c7-8063-b2a9dff1cd9f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "cinder-91b041f3-32b4-40c7-8063-b2a9dff1cd9f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Acquiring lock "cinder-quobyte-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "cinder-quobyte-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:45 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpar9ix95m/privsep.sock'] Sep 28 18:13:45 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpar9ix95m/privsep.sock Sep 28 18:13:45 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:13:47 devstack cinder-volume[86560]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 18:13:47 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Spawned new privsep daemon via rootwrap Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Accepted privsep connection to /tmp/tmpar9ix95m/privsep.sock {{(pid=86560) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 18:13:48 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 18:13:48 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 18:13:48 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 18:13:48 devstack cinder-volume[86560]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88316 Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bbf43f-629b-4c64-b767-0b0ecc58f052]: (2,) {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8a65d9-ff2d-46d5-8081-08d66b2a13ad]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Flow 'volume_create_manager' (a4b7eaa4-d5f7-4700-9d02-8efec6e35540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559b6cc2-3db6-4bf9-941c-0056534bf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559b6cc2-3db6-4bf9-941c-0056534bf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-607135948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0a069a-3211-4e96-964a-c681358c1764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa7c4bd28c4862836ebb23afdaad68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:48Z,use_quota=True,user_id='cec2c2d5c509422280348e7b27e691c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a76a6e-db0f-49bf-9d34-81880b45030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a76a6e-db0f-49bf-9d34-81880b45030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338e29dc-85ed-4768-a2d5-18390027d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338e29dc-85ed-4768-a2d5-18390027d59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0a069a-3211-4e96-964a-c681358c1764', 'volume_name': 'volume-7b0a069a-3211-4e96-964a-c681358c1764', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101787b1-e30e-4ac6-a9b5-c584b360a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101787b1-e30e-4ac6-a9b5-c584b360a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f46dd0d-4a6c-48ef-968e-ee509ee48c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Volume 7b0a069a-3211-4e96-964a-c681358c1764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0a069a-3211-4e96-964a-c681358c1764', 'volume_size': 1} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-607135948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0a069a-3211-4e96-964a-c681358c1764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa7c4bd28c4862836ebb23afdaad68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:48Z,use_quota=True,user_id='cec2c2d5c509422280348e7b27e691c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Creating volume 7b0a069a-3211-4e96-964a-c681358c1764 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:48 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:13:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f Sep 28 18:13:48 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 1073741824 Sep 28 18:13:48 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" returned: 0 in 1.199s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 1073741824" returned: 0 in 0.979s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f Sep 28 18:13:49 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 Sep 28 18:13:49 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" returned: 0 in 0.625s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "cinder-quobyte-91b041f3-32b4-40c7-8063-b2a9dff1cd9f" released by "delete_volume" :: held 4.444s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:49 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764" returned: 0 in 0.591s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f46dd0d-4a6c-48ef-968e-ee509ee48c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0a069a-3211-4e96-964a-c681358c1764', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0443b5ea-b6a8-4c37-ae31-aa7498fda4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86560]: WARNING cinder.quota [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:50 devstack cinder-volume[86560]: WARNING cinder.quota [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Volume volume-7b0a069a-3211-4e96-964a-c681358c1764 (7b0a069a-3211-4e96-964a-c681358c1764): created successfully Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0443b5ea-b6a8-4c37-ae31-aa7498fda4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Flow 'volume_create_manager' (a4b7eaa4-d5f7-4700-9d02-8efec6e35540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4dea2bb2-7cc6-467b-ad98-ff5ba57636aa tempest-ServerActionsTestOtherA-350002319 None] Created volume successfully. Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Created reservations ['5ac33d0d-3c0b-4098-bbaa-7a4ed9fecb79', 'd3f28c67-fc4c-4261-907b-b4f39746cfc1', '2f43346f-b119-4375-bffe-5a899781031d', '93f93431-bfd8-4de4-8af6-2654832b1ef3'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:50 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:13:50 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Deleted volume successfully. Sep 28 18:13:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c4771966-9226-4b6a-a9be-bf9bb5de442f tempest-ServerRescueNegativeTestJSON-1462396131 None] Lock "cinder-91b041f3-32b4-40c7-8063-b2a9dff1cd9f-delete_volume" released by "delete_volume" :: held 5.734s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:00 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:00 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:00 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 8 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:14:00 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=13,cinder:SELECT=7,cinder:INSERT=3 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:01 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (683fc9d6-d1ef-4c5f-b332-8fc985cec0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060ef9cd-696c-4947-8ff0-c0e58c0ddff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060ef9cd-696c-4947-8ff0-c0e58c0ddff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537318098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90408889-0b9f-4a99-9552-7648fb8c98df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:26Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7100b-6f4d-426a-821d-b542bbc43c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7100b-6f4d-426a-821d-b542bbc43c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228ebc9b-03c7-4bf2-b4e3-0fb8e9100fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228ebc9b-03c7-4bf2-b4e3-0fb8e9100fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90408889-0b9f-4a99-9552-7648fb8c98df', 'volume_name': 'volume-90408889-0b9f-4a99-9552-7648fb8c98df', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52106368-cdd8-4e14-8a2f-e627cbc86e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52106368-cdd8-4e14-8a2f-e627cbc86e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2732c3-4fb9-46e7-b3ef-63e7e1d93683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Volume 90408889-0b9f-4a99-9552-7648fb8c98df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90408889-0b9f-4a99-9552-7648fb8c98df', 'volume_size': 1} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537318098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90408889-0b9f-4a99-9552-7648fb8c98df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:26Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Creating volume 90408889-0b9f-4a99-9552-7648fb8c98df {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:25 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:14:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:25 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df 1073741824 Sep 28 18:14:25 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:26 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df 1073741824" returned: 0 in 0.999s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:27 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df Sep 28 18:14:27 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:27 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df" returned: 0 in 1.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2732c3-4fb9-46e7-b3ef-63e7e1d93683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90408889-0b9f-4a99-9552-7648fb8c98df', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c0a7cf-7358-4c95-9310-e1e39e371080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Volume volume-90408889-0b9f-4a99-9552-7648fb8c98df (90408889-0b9f-4a99-9552-7648fb8c98df): created successfully Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c0a7cf-7358-4c95-9310-e1e39e371080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (683fc9d6-d1ef-4c5f-b332-8fc985cec0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:28 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-93da13ab-14c3-41e1-b119-f5e157531ea5 tempest-VolumesTestJSON-929408997 None] Created volume successfully. Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (51c8035c-c7f0-4b95-927d-bb17aedbbdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e19d3a-d941-4f32-b7a1-ee86531b702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:30 devstack cinder-volume[86560]: WARNING py.warnings [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 18:14:30 devstack cinder-volume[86560]: .first() Sep 28 18:14:30 devstack cinder-volume[86560]: Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e19d3a-d941-4f32-b7a1-ee86531b702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-559671313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f510cb01-a7cf-4e2d-a282-a1608e003009,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:30Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef415a-8cea-4dae-9449-95e092014b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef415a-8cea-4dae-9449-95e092014b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e192cc-0dcf-47ce-a654-35c496743831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e192cc-0dcf-47ce-a654-35c496743831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f510cb01-a7cf-4e2d-a282-a1608e003009', 'volume_name': 'volume-f510cb01-a7cf-4e2d-a282-a1608e003009', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd672929-1120-4baf-ba8c-73b30c7f8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd672929-1120-4baf-ba8c-73b30c7f8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80d145-763e-47c8-9cd6-cb4d7f6527cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Volume f510cb01-a7cf-4e2d-a282-a1608e003009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f510cb01-a7cf-4e2d-a282-a1608e003009', 'volume_size': 1} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-559671313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f510cb01-a7cf-4e2d-a282-a1608e003009,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:30Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Creating volume f510cb01-a7cf-4e2d-a282-a1608e003009 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:30 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:30 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 1073741824 Sep 28 18:14:30 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:31 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 1073741824" returned: 0 in 0.714s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:31 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 Sep 28 18:14:31 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:31 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009" returned: 0 in 0.325s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.060s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80d145-763e-47c8-9cd6-cb4d7f6527cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f510cb01-a7cf-4e2d-a282-a1608e003009', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7af790a-a6c2-4321-9876-17d2af05a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Volume volume-f510cb01-a7cf-4e2d-a282-a1608e003009 (f510cb01-a7cf-4e2d-a282-a1608e003009): created successfully Sep 28 18:14:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7af790a-a6c2-4321-9876-17d2af05a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (51c8035c-c7f0-4b95-927d-bb17aedbbdd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-15dab453-d5aa-419e-a4e8-71b32a96445b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39b62b8b-6870-4fc9-8da9-463122618b26', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0cf32f9d-2b5e-4519-a215-8fbc3d1d744b tempest-VolumesTestJSON-929408997 None] Created volume successfully. Sep 28 18:14:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-fe5e1b85-51e0-42b1-93fb-fe51e411b5c9 req-23328658-809b-4c07-82e4-8efcb0df6840 tempest-TaggedAttachmentsTest-436060271 None] attachment_update completed successfully. Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (22a034cc-d275-46cf-ad1d-1d5ef7d65516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cfea55-a250-4f0c-83c9-cda7fe25e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cfea55-a250-4f0c-83c9-cda7fe25e55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-148404921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d248b0-751d-411d-9bbe-7ca48c6501fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:34Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb7ada-be4b-4d50-bd2a-527468c95c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb7ada-be4b-4d50-bd2a-527468c95c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb31805-4a22-4758-a160-e40e42bd6815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb31805-4a22-4758-a160-e40e42bd6815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d248b0-751d-411d-9bbe-7ca48c6501fe', 'volume_name': 'volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d302360-0011-45dc-bafe-49137eebf003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d302360-0011-45dc-bafe-49137eebf003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee99cbd-a02b-4603-beec-1823802b5d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Volume c4d248b0-751d-411d-9bbe-7ca48c6501fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe', 'volume_size': 1} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-148404921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d248b0-751d-411d-9bbe-7ca48c6501fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecdf0812d4f4945887ab89a48c563ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:34Z,use_quota=True,user_id='13918b10044e445294f5f369c24b5368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Creating volume c4d248b0-751d-411d-9bbe-7ca48c6501fe {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:34 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:34 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe 1073741824 Sep 28 18:14:34 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:34 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe 1073741824" returned: 0 in 0.757s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:34 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe Sep 28 18:14:34 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:35 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe" returned: 0 in 0.288s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee99cbd-a02b-4603-beec-1823802b5d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd128698-4389-4109-87c5-f01da94ae822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:35 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Volume volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe (c4d248b0-751d-411d-9bbe-7ca48c6501fe): created successfully Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd128698-4389-4109-87c5-f01da94ae822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Flow 'volume_create_manager' (22a034cc-d275-46cf-ad1d-1d5ef7d65516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-67a41713-e93b-45be-aab4-1bb63648a343 tempest-VolumesTestJSON-929408997 None] Created volume successfully. Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-c4d248b0-751d-411d-9bbe-7ca48c6501fe-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "cinder-c4d248b0-751d-411d-9bbe-7ca48c6501fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-quobyte-c4d248b0-751d-411d-9bbe-7ca48c6501fe" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-c4d248b0-751d-411d-9bbe-7ca48c6501fe" acquired by "delete_volume" :: waited 0.040s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[da79f7c4-dd68-4f4f-bf42-caca061af8bf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-faf99c38-f716-44be-aefc-59f8c8b97635 req-1dda4bd7-4c03-437c-b242-93405196b298 tempest-TaggedAttachmentsTest-436060271 None] Terminate volume connection completed successfully. Sep 28 18:14:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-faf99c38-f716-44be-aefc-59f8c8b97635 req-1dda4bd7-4c03-437c-b242-93405196b298 tempest-TaggedAttachmentsTest-436060271 None] Deleting attachment 39b62b8b-6870-4fc9-8da9-463122618b26. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:14:37 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe Sep 28 18:14:37 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe" returned: 0 in 1.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe Sep 28 18:14:38 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:39 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Flow 'volume_create_manager' (96421219-3a11-44a8-a811-e2a5438023b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c732e0-a689-42fa-8c76-fcb733675a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c4d248b0-751d-411d-9bbe-7ca48c6501fe" returned: 0 in 0.988s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c732e0-a689-42fa-8c76-fcb733675a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1339395060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0badbde7-1b25-41fb-9e97-11174be9fba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d702af7d0d2b448fae00dea4dcda68fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='a8ff1533afa447f69b32be83d4bed256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64942b32-5e06-42c4-a410-28f2c88af2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64942b32-5e06-42c4-a410-28f2c88af2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c021c56-72de-4392-a12c-ac6e13418cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c021c56-72de-4392-a12c-ac6e13418cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0badbde7-1b25-41fb-9e97-11174be9fba2', 'volume_name': 'volume-0badbde7-1b25-41fb-9e97-11174be9fba2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b9276-c5a9-48d1-a61c-e40c4ad4ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b9276-c5a9-48d1-a61c-e40c4ad4ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98359ace-67f8-4ef8-9264-90b39779ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Volume 0badbde7-1b25-41fb-9e97-11174be9fba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0badbde7-1b25-41fb-9e97-11174be9fba2', 'volume_size': 1} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1339395060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0badbde7-1b25-41fb-9e97-11174be9fba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d702af7d0d2b448fae00dea4dcda68fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='a8ff1533afa447f69b32be83d4bed256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Creating volume 0badbde7-1b25-41fb-9e97-11174be9fba2 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:39 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-c4d248b0-751d-411d-9bbe-7ca48c6501fe" released by "delete_volume" :: held 2.212s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:39 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 1073741824 Sep 28 18:14:39 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Created reservations ['106aab73-22e0-41b9-a420-65a88b0b44e8', 'af835809-b552-4b08-9300-60f2a0b3babb', 'e7a6ffb0-7e47-4115-bf6c-57ea0cf673b1', '3bdbef3c-1193-42fd-a111-ee1c79c2fd2f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:39 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 1073741824" returned: 0 in 0.855s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.579s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Deleted volume successfully. Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cf8bf1ae-aea9-475c-a13a-36c6ced88141 tempest-VolumesTestJSON-929408997 None] Lock "cinder-c4d248b0-751d-411d-9bbe-7ca48c6501fe-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:40 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 Sep 28 18:14:40 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2" returned: 0 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98359ace-67f8-4ef8-9264-90b39779ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0badbde7-1b25-41fb-9e97-11174be9fba2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1785914f-0266-4648-8348-796dc0d83f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Volume volume-0badbde7-1b25-41fb-9e97-11174be9fba2 (0badbde7-1b25-41fb-9e97-11174be9fba2): created successfully Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1785914f-0266-4648-8348-796dc0d83f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Flow 'volume_create_manager' (96421219-3a11-44a8-a811-e2a5438023b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7b8c8451-aace-4177-ad74-44ed86bbba35 tempest-VolumesAdminNegativeTest-1799457021 None] Created volume successfully. Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-f510cb01-a7cf-4e2d-a282-a1608e003009-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "cinder-f510cb01-a7cf-4e2d-a282-a1608e003009-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-quobyte-f510cb01-a7cf-4e2d-a282-a1608e003009" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-f510cb01-a7cf-4e2d-a282-a1608e003009" acquired by "delete_volume" :: waited 0.048s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6e11a-ad0e-4e6c-8484-f9edcf35e078]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 Sep 28 18:14:41 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Acquiring lock "cinder-0badbde7-1b25-41fb-9e97-11174be9fba2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "cinder-0badbde7-1b25-41fb-9e97-11174be9fba2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Acquiring lock "cinder-quobyte-0badbde7-1b25-41fb-9e97-11174be9fba2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "cinder-quobyte-0badbde7-1b25-41fb-9e97-11174be9fba2" acquired by "delete_volume" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:42 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009" returned: 0 in 0.695s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ec010-b89c-4df5-920f-2af1b5cfc581]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:42 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009 Sep 28 18:14:42 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 Sep 28 18:14:42 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f510cb01-a7cf-4e2d-a282-a1608e003009" returned: 0 in 0.533s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-f510cb01-a7cf-4e2d-a282-a1608e003009" released by "delete_volume" :: held 1.337s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Created reservations ['4f5ebcd9-65a7-46ef-87c6-5500ff34bb09', '5da6d8bf-484e-43a0-a550-b146b78327bd', '6938de19-c7ca-4071-9432-8a5b1c9c983c', '75790a71-7761-4588-bdd5-2fc67768ca71'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:43 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:43 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2" returned: 0 in 0.981s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2 Sep 28 18:14:43 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:43 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.463s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Deleted volume successfully. Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0790f372-eade-4f77-be3f-4d44c28cc396 tempest-VolumesTestJSON-929408997 None] Lock "cinder-f510cb01-a7cf-4e2d-a282-a1608e003009-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:43 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0badbde7-1b25-41fb-9e97-11174be9fba2" returned: 0 in 0.463s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "cinder-quobyte-0badbde7-1b25-41fb-9e97-11174be9fba2" released by "delete_volume" :: held 1.542s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-90408889-0b9f-4a99-9552-7648fb8c98df-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Created reservations ['ce751f5f-2007-4035-8bf8-ed555919e2ae', 'b80b0aa5-346b-4d0d-a8b3-1693e9915620', '742e3de4-f119-4f6d-9007-c719e93114ee', 'f9b01168-56a7-4143-987a-38f156abc940'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "cinder-90408889-0b9f-4a99-9552-7648fb8c98df-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Acquiring lock "cinder-quobyte-90408889-0b9f-4a99-9552-7648fb8c98df" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-90408889-0b9f-4a99-9552-7648fb8c98df" acquired by "delete_volume" :: waited 0.086s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce383fa-cb2e-48a5-afa1-33c16d6b9c1c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:44 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:44 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df Sep 28 18:14:44 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:45 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.872s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:45 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Deleted volume successfully. Sep 28 18:14:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fb790856-a5e3-4ffc-92a1-a683a5334a67 tempest-VolumesAdminNegativeTest-1799457021 None] Lock "cinder-0badbde7-1b25-41fb-9e97-11174be9fba2-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:45 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df" returned: 0 in 1.146s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:45 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df Sep 28 18:14:45 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a3155611-8719-4039-a127-cffdd2b7d960 req-ea7fbf74-e90b-4008-9ac2-0103f73243c7 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a3155611-8719-4039-a127-cffdd2b7d960 req-ea7fbf74-e90b-4008-9ac2-0103f73243c7 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a3155611-8719-4039-a127-cffdd2b7d960 req-ea7fbf74-e90b-4008-9ac2-0103f73243c7 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:46 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-90408889-0b9f-4a99-9552-7648fb8c98df" returned: 0 in 0.493s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-a3155611-8719-4039-a127-cffdd2b7d960 req-ea7fbf74-e90b-4008-9ac2-0103f73243c7 tempest-ServerActionsTestOtherA-350002319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-7b0a069a-3211-4e96-964a-c681358c1764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b83f7ea-5e5d-4740-890d-1a6c1caf3775', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "cinder-quobyte-90408889-0b9f-4a99-9552-7648fb8c98df" released by "delete_volume" :: held 1.824s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Created reservations ['f20659d9-66f6-400d-b510-0d5780546d86', 'f282eeee-db69-43bb-a381-07b3cbb3b48f', '5696e0c0-c681-4639-9394-e2262965f8a5', 'c67073bc-7ac3-4d1f-a8d2-a414aa90219c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-a3155611-8719-4039-a127-cffdd2b7d960 req-ea7fbf74-e90b-4008-9ac2-0103f73243c7 tempest-ServerActionsTestOtherA-350002319 None] attachment_update completed successfully. Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:46 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:46 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.638s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Deleted volume successfully. Sep 28 18:14:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f5aba97-2156-48dd-8a52-7b9588684d2a tempest-VolumesTestJSON-929408997 None] Lock "cinder-90408889-0b9f-4a99-9552-7648fb8c98df-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-8cc539bf-b903-4817-bf3b-2d84e691e0d7 tempest-ServerActionsTestOtherA-350002319 None] Terminate volume connection completed successfully. Sep 28 18:14:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-8cc539bf-b903-4817-bf3b-2d84e691e0d7 tempest-ServerActionsTestOtherA-350002319 None] Deleting attachment 8b83f7ea-5e5d-4740-890d-1a6c1caf3775. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:14:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-02012205-ac9b-49f7-b4c3-3c6d968e688d tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-02012205-ac9b-49f7-b4c3-3c6d968e688d tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-02012205-ac9b-49f7-b4c3-3c6d968e688d tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-02012205-ac9b-49f7-b4c3-3c6d968e688d tempest-ServerActionsTestOtherA-350002319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-7b0a069a-3211-4e96-964a-c681358c1764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71adc496-9cae-4a52-bc92-677b022ad906', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-bbbc4fc8-f504-401a-b002-3a2916910f6b req-02012205-ac9b-49f7-b4c3-3c6d968e688d tempest-ServerActionsTestOtherA-350002319 None] attachment_update completed successfully. Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "cinder-15dab453-d5aa-419e-a4e8-71b32a96445b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-73007000-f4a2-426c-be04-9f26e48fc6b6 tempest-GroupSnapshotsV319Test-568571215 None] Group tempest-GroupSnapshotsV319Test-Group-1960870186: creating Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "cinder-15dab453-d5aa-419e-a4e8-71b32a96445b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "cinder-quobyte-15dab453-d5aa-419e-a4e8-71b32a96445b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-73007000-f4a2-426c-be04-9f26e48fc6b6 tempest-GroupSnapshotsV319Test-568571215 None] Group tempest-GroupSnapshotsV319Test-Group-1960870186: created successfully Sep 28 18:14:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-73007000-f4a2-426c-be04-9f26e48fc6b6 tempest-GroupSnapshotsV319Test-568571215 None] Create group completed successfully. Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "cinder-quobyte-15dab453-d5aa-419e-a4e8-71b32a96445b" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6f6a9-5b6a-49d3-9bf6-a381f4b22e1b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b Sep 28 18:14:56 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b Sep 28 18:14:56 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15dab453-d5aa-419e-a4e8-71b32a96445b" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "cinder-quobyte-15dab453-d5aa-419e-a4e8-71b32a96445b" released by "delete_volume" :: held 0.804s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:56 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Created reservations ['35ab68b6-c12f-4fdd-a39c-7c9355f96d22', 'e38d90b5-8c58-4045-8036-8e47fbd055a2', 'cb09a8a1-6fba-4877-a028-9e3d3954fd04', '8329c150-869a-4480-ac3f-ad696a45af3d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:57 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:14:57 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:57 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Deleted volume successfully. Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0547f508-ded6-444a-b222-3a792a41b171 tempest-TaggedAttachmentsTest-436060271 None] Lock "cinder-15dab453-d5aa-419e-a4e8-71b32a96445b-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:57 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Flow 'volume_create_manager' (6c5230f6-078f-4d35-b581-7c62aae6cbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511cde1-49c6-404c-869a-b8ac7a554890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511cde1-49c6-404c-869a-b8ac7a554890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227628587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=421d4713-d687-4233-8ddb-78163243ee8a,host='devstack@QuobyteHD#QuobyteHD',id=2576678d-7b11-4876-a3dc-5be60fe4ce13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c353d4fd38041758b34d25990f2a12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:58Z,use_quota=True,user_id='42707ae7ec3d4ed18e2dc0a3fbe37f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea5b20a-1d7f-4019-ace8-5363a01692a5),volume_type_id=0ea5b20a-1d7f-4019-ace8-5363a01692a5)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1a3f02-48d0-4a4a-9ddf-1a30013165a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1a3f02-48d0-4a4a-9ddf-1a30013165a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495d60f1-8680-4a4d-bffc-27686e61a851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495d60f1-8680-4a4d-bffc-27686e61a851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2576678d-7b11-4876-a3dc-5be60fe4ce13', 'volume_name': 'volume-2576678d-7b11-4876-a3dc-5be60fe4ce13', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc749df2-0ead-4471-9ae2-5e36e2e3827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc749df2-0ead-4471-9ae2-5e36e2e3827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf253c70-527e-4567-add5-eebdf4d3aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Volume 2576678d-7b11-4876-a3dc-5be60fe4ce13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2576678d-7b11-4876-a3dc-5be60fe4ce13', 'volume_size': 1} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=421d4713-d687-4233-8ddb-78163243ee8a,created_at=2026-09-28T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227628587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=421d4713-d687-4233-8ddb-78163243ee8a,host='devstack@QuobyteHD#QuobyteHD',id=2576678d-7b11-4876-a3dc-5be60fe4ce13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c353d4fd38041758b34d25990f2a12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:58Z,use_quota=True,user_id='42707ae7ec3d4ed18e2dc0a3fbe37f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea5b20a-1d7f-4019-ace8-5363a01692a5),volume_type_id=0ea5b20a-1d7f-4019-ace8-5363a01692a5)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Creating volume 2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:58 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:58 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 1073741824 Sep 28 18:14:58 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:58 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 1073741824" returned: 0 in 0.710s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:58 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 Sep 28 18:14:58 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:59 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13" returned: 0 in 0.466s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf253c70-527e-4567-add5-eebdf4d3aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2576678d-7b11-4876-a3dc-5be60fe4ce13', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50917af-a75d-4f96-a1f4-aced3a3ee669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:59 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Volume volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 (2576678d-7b11-4876-a3dc-5be60fe4ce13): created successfully Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50917af-a75d-4f96-a1f4-aced3a3ee669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Flow 'volume_create_manager' (6c5230f6-078f-4d35-b581-7c62aae6cbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a3a41eec-cbb7-4031-adf7-5eecc754d3f1 tempest-GroupSnapshotsV319Test-568571215 None] Created volume successfully. Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:00 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:15:00 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:00 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.390s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] GroupSnapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: creating. Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Group snapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: creating. {{(pid=86560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Creating offline snapshot 232e118b-f51c-4fa8-ba1d-2b284a6f82ee of volume 2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a38ee2-4f4d-4250-bfc7-fc490420bfcc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:01 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 Sep 28 18:15:01 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13" returned: 0 in 0.604s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee 1G Sep 28 18:15:02 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee 1G" returned: 0 in 0.736s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee Sep 28 18:15:02 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee" returned: 0 in 0.441s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:15:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee Sep 28 18:15:03 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee" returned: 0 in 0.425s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info Sep 28 18:15:03 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info" returned: 0 in 0.406s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:15:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:04 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info Sep 28 18:15:04 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.info" returned: 0 in 0.313s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d7ec8ca2-1481-40e2-bfdc-06bd94f60b02 tempest-GroupSnapshotsV319Test-568571215 None] group_snapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: created successfully Sep 28 18:15:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] group_snapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: deleting Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] group_snapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: deleting {{(pid=86560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "cinder-quobyte-232e118b-f51c-4fa8-ba1d-2b284a6f82ee" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-232e118b-f51c-4fa8-ba1d-2b284a6f82ee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Deleting offline snapshot 232e118b-f51c-4fa8-ba1d-2b284a6f82ee of volume 2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] snapshot_file for this snap is: volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[22100f80-172f-4724-bfbf-cf62af596785]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee Sep 28 18:15:06 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:06 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee" returned: 0 in 0.648s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2576678d-7b11-4876-a3dc-5be60fe4ce13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a443413-4ed3-413d-9e35-bc9244f7c3dc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 Sep 28 18:15:06 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:07 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee Sep 28 18:15:07 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee" returned: 0 in 0.605s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:07 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee Sep 28 18:15:07 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13.232e118b-f51c-4fa8-ba1d-2b284a6f82ee" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-232e118b-f51c-4fa8-ba1d-2b284a6f82ee" released by "_delete_snapshot" :: held 2.312s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" released by "delete_snapshot" :: held 2.346s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:08 devstack cinder-volume[86560]: WARNING cinder.quota [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-245703366 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-245703366, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:08 devstack cinder-volume[86560]: WARNING cinder.quota [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-245703366 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-245703366, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] Created reservations ['15ab3fa5-6dec-402e-bf98-88263b6f2b68', '421772d3-bdf3-49da-82c7-f3e2fa1e87be', '2e1057cf-93c8-4373-a027-b369b20f3e2c', '913d6423-5717-4456-b66a-f70ad6e4fa79'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-27c29a56-7a5e-4d38-b871-ca2bec0c0732 tempest-GroupSnapshotsV319Test-568571215 None] group_snapshot f88c07fa-86be-47ae-a7be-e1285fd9e087: deleted successfully Sep 28 18:15:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc3c8a-a1b5-46ef-aa83-856017d3ddaf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:09 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 Sep 28 18:15:09 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:09 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13" returned: 0 in 0.492s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:09 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13 Sep 28 18:15:09 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:09 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2576678d-7b11-4876-a3dc-5be60fe4ce13" returned: 0 in 0.350s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Lock "cinder-quobyte-2576678d-7b11-4876-a3dc-5be60fe4ce13" released by "delete_volume" :: held 0.943s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Created reservations ['60a918be-a274-42f2-9485-474f8acb9ca6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:10 devstack cinder-volume[86560]: WARNING cinder.quota [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-245703366 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-245703366, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Created reservations ['491ebc68-5240-4f9f-aeae-e1c7480060c2', '7a556cf2-5e3a-4d83-8ba4-c079eab3f88b', '9652c925-07ef-44a6-b6cb-8e8f9a60b082', 'e8093e4c-18b4-49a9-9558-4bd4a0e10e15'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:10 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:15:10 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:10 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:10 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1531ee29-39f9-468c-b6a6-3b3c4bb78906 tempest-GroupSnapshotsV319Test-568571215 None] Delete group completed successfully. Sep 28 18:15:20 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=72,cinder:UPDATE=78,cinder:DELETE=5,cinder:INSERT=20 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:20 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=81,cinder:SELECT=86,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Flow 'volume_create_manager' (59666d23-9a3d-4887-84f6-b3faa9f8b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8456c-aa04-4488-be65-fc94dbc4585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8456c-aa04-4488-be65-fc94dbc4585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2030988043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee22810b-6138-4dc8-b270-686b879bd6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a72c0ddce44164997406fffb1ef2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:21Z,use_quota=True,user_id='f57a7fc80a024e0c9240780401098e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb426e1-dec9-4853-8de4-9d7a7dcfa429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb426e1-dec9-4853-8de4-9d7a7dcfa429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31241387-f659-41d5-bc48-a9e57fc84b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31241387-f659-41d5-bc48-a9e57fc84b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee22810b-6138-4dc8-b270-686b879bd6fc', 'volume_name': 'volume-ee22810b-6138-4dc8-b270-686b879bd6fc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac039fe8-a69a-4aca-aeb0-9d49f62ec98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac039fe8-a69a-4aca-aeb0-9d49f62ec98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be58ba3-6dc5-45dd-a342-dc1f91b73b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Volume ee22810b-6138-4dc8-b270-686b879bd6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee22810b-6138-4dc8-b270-686b879bd6fc', 'volume_size': 1} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2030988043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee22810b-6138-4dc8-b270-686b879bd6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a72c0ddce44164997406fffb1ef2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:21Z,use_quota=True,user_id='f57a7fc80a024e0c9240780401098e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Creating volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:15:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:21 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc 1073741824 Sep 28 18:15:21 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:22 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc 1073741824" returned: 0 in 0.655s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:22 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc Sep 28 18:15:22 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:22 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be58ba3-6dc5-45dd-a342-dc1f91b73b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee22810b-6138-4dc8-b270-686b879bd6fc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf835a6-fbe6-42fd-9d06-8b862115a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Volume volume-ee22810b-6138-4dc8-b270-686b879bd6fc (ee22810b-6138-4dc8-b270-686b879bd6fc): created successfully Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf835a6-fbe6-42fd-9d06-8b862115a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Flow 'volume_create_manager' (59666d23-9a3d-4887-84f6-b3faa9f8b034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-243819c6-2a75-4304-81e7-1f396a5460f0 tempest-SnapshotsActionsTest-1064894849 None] Created volume successfully. Sep 28 18:15:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Creating offline snapshot c5524628-ef1a-4161-85e1-d394bd4e2480 of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:23 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a3722-e604-4801-88cb-3d76fbbb7f36]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:23 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc Sep 28 18:15:23 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:24 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc" returned: 0 in 0.536s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:24 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 1G Sep 28 18:15:24 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:24 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 1G" returned: 0 in 0.639s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:24 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:25 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:25 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.552s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 is being set with open permissions: ugo+rw Sep 28 18:15:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:25 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:25 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:25 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.465s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:26 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info Sep 28 18:15:26 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:26 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info" returned: 0 in 0.399s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:26 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info is being set with open permissions: ugo+rw Sep 28 18:15:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:26 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info Sep 28 18:15:26 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:26 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.info" returned: 0 in 0.455s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.185s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f5104b20-8685-45c3-b24b-c28288b1cf32 tempest-SnapshotsActionsTest-1064894849 None] Create snapshot completed successfully Sep 28 18:15:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Creating offline snapshot 47ac007b-dee1-4d4d-ae9a-059d0dccbf2e of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1babfc-7840-4ae2-b94a-bc3a02c6994c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:29 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:29 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:29 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.712s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:29 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e 1G Sep 28 18:15:29 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-32b3a492-0034-4197-a262-6e79c9c99f3c req-a6579891-0bd8-41ad-a80c-dcc5e15e2dd7 tempest-ServerActionsTestOtherA-350002319 None] Terminate volume connection completed successfully. Sep 28 18:15:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-32b3a492-0034-4197-a262-6e79c9c99f3c req-a6579891-0bd8-41ad-a80c-dcc5e15e2dd7 tempest-ServerActionsTestOtherA-350002319 None] Deleting attachment 71adc496-9cae-4a52-bc92-677b022ad906. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:30 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e 1G" returned: 0 in 0.809s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:30 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e Sep 28 18:15:30 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:31 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" returned: 0 in 0.497s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e is being set with open permissions: ugo+rw Sep 28 18:15:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:31 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e Sep 28 18:15:31 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:31 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-56783ad9-2c2e-4ad9-8971-234dc749a242 tempest-SnapshotsActionsTest-1064894849 None] Create snapshot completed successfully Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Deleting offline snapshot 47ac007b-dee1-4d4d-ae9a-059d0dccbf2e of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] snapshot_file for this snap is: volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[392df83a-30a8-4001-ac08-6a82b6f94ac0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:32 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e Sep 28 18:15:32 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:33 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" returned: 0 in 0.613s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde0bcbb-6409-4f49-854b-1516e6e3a8ad]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:33 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:33 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:33 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.694s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:33 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e Sep 28 18:15:33 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:34 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" returned: 0 in 0.550s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:34 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e Sep 28 18:15:34 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:34 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e" released by "_delete_snapshot" :: held 2.457s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_snapshot" :: held 2.495s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:34 devstack cinder-volume[86560]: WARNING cinder.quota [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:34 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Created reservations ['acefab58-ac97-4113-9cb1-dfdb56cc99af', '6bf5584e-817a-4e40-8973-6ca107a7dc78', 'd1da86ab-ba35-47d7-af1a-d6334abeb504', 'c875d730-2348-4a44-a495-a84d20eb736b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Delete snapshot completed successfully. Sep 28 18:15:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d158c99d-2115-4b0f-ba12-5a077aa98bf1 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-47ac007b-dee1-4d4d-ae9a-059d0dccbf2e-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Creating offline snapshot 5a6e21b6-6f19-453e-9306-dc89be37d9cd of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e3e97-8ff4-4ec5-9620-d988228f6587]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:36 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:36 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:36 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.685s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:36 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd 1G Sep 28 18:15:36 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:37 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd 1G" returned: 0 in 0.745s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:37 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd Sep 28 18:15:37 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:38 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd" returned: 0 in 0.530s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:38 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd is being set with open permissions: ugo+rw Sep 28 18:15:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:38 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd Sep 28 18:15:38 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:38 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd" returned: 0 in 0.491s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:38 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-75bf0bd8-b3ee-43e9-9dcd-98a041891fc6 tempest-SnapshotsActionsTest-1064894849 None] Create snapshot completed successfully Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-5a6e21b6-6f19-453e-9306-dc89be37d9cd-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-5a6e21b6-6f19-453e-9306-dc89be37d9cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-5a6e21b6-6f19-453e-9306-dc89be37d9cd" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-5a6e21b6-6f19-453e-9306-dc89be37d9cd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Deleting offline snapshot 5a6e21b6-6f19-453e-9306-dc89be37d9cd of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] snapshot_file for this snap is: volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fccf35-e4b3-4f20-b727-7c33054e5924]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:39 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd Sep 28 18:15:39 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:40 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd" returned: 0 in 0.806s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c1787-aa03-4b0b-9802-0c77d1377fc3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:40 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:40 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:41 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.556s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:41 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd Sep 28 18:15:41 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:41 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd" returned: 0 in 0.606s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:41 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd Sep 28 18:15:41 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:42 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.5a6e21b6-6f19-453e-9306-dc89be37d9cd" returned: 0 in 0.369s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-5a6e21b6-6f19-453e-9306-dc89be37d9cd" released by "_delete_snapshot" :: held 2.539s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_snapshot" :: held 2.570s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:42 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Created reservations ['0526a05c-9c07-4eaf-b610-a18c20509104', 'fa1d9ca5-6b42-4693-b459-320bf9228e95', 'da6d7192-1008-49c6-8ce5-8c1877f06361', 'f3dc89b9-351f-4e34-89eb-3bd6960c2f43'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Delete snapshot completed successfully. Sep 28 18:15:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-77b09947-4b06-4500-9dd5-dcc84fc67eb3 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-5a6e21b6-6f19-453e-9306-dc89be37d9cd-delete_snapshot" released by "delete_snapshot" :: held 2.813s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Flow 'volume_create_manager' (fad9e190-7f24-4bbe-a7f2-2511b165ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6794d01-9ce6-46f0-a758-ac037d1b081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6794d01-9ce6-46f0-a758-ac037d1b081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1291951186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0133e477-7eec-4f15-970d-dd14ee9e8709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa7c4bd28c4862836ebb23afdaad68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:43Z,use_quota=True,user_id='cec2c2d5c509422280348e7b27e691c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e6793c-6c1d-4a81-be8c-f0cac7c4b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e6793c-6c1d-4a81-be8c-f0cac7c4b25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff9f112-679c-4cfd-9f41-d37f77e958c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Creating offline snapshot 13e109ab-d876-419f-b5fe-2b622ec6166b of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7e993-63cf-4d60-b0f1-f1c218d3dd73]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:43 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:43 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff9f112-679c-4cfd-9f41-d37f77e958c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0133e477-7eec-4f15-970d-dd14ee9e8709', 'volume_name': 'volume-0133e477-7eec-4f15-970d-dd14ee9e8709', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c445190e-fbd6-4bf9-8ae1-04adb85f6905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c445190e-fbd6-4bf9-8ae1-04adb85f6905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c852fa-c54d-41ac-a528-78d9f786ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Volume 0133e477-7eec-4f15-970d-dd14ee9e8709: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0133e477-7eec-4f15-970d-dd14ee9e8709', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Trying to clone 0133e477-7eec-4f15-970d-dd14ee9e8709 from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:15:44 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.633s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:44 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b 1G Sep 28 18:15:44 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:45 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:15:45 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:15:45 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d6ebd-fdb2-4515-adcf-5268a0b65dd5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:45 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b 1G" returned: 0 in 1.163s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:45 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b Sep 28 18:15:45 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:45 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD Sep 28 18:15:45 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:46 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD" returned: 0 in 0.829s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 is fetched for user cec2c2d5c509422280348e7b27e691c4. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:15:46 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b" returned: 0 in 0.805s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:46 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b is being set with open permissions: ugo+rw Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:46 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b Sep 28 18:15:46 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[66723987-747e-48f8-afd5-6cf9911bfb65]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:46 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD Sep 28 18:15:46 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:46 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b" returned: 0 in 0.546s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6c4fe484-ad7e-4367-884c-6aad5e496b00 tempest-SnapshotsActionsTest-1064894849 None] Create snapshot completed successfully Sep 28 18:15:47 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1291951186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0133e477-7eec-4f15-970d-dd14ee9e8709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa7c4bd28c4862836ebb23afdaad68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:43Z,use_quota=True,user_id='cec2c2d5c509422280348e7b27e691c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Creating volume 0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:47 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1073741824 Sep 28 18:15:47 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1073741824" returned: 0 in 0.570s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 Sep 28 18:15:47 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-13e109ab-d876-419f-b5fe-2b622ec6166b-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-13e109ab-d876-419f-b5fe-2b622ec6166b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-13e109ab-d876-419f-b5fe-2b622ec6166b" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-13e109ab-d876-419f-b5fe-2b622ec6166b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Deleting offline snapshot 13e109ab-d876-419f-b5fe-2b622ec6166b of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] snapshot_file for this snap is: volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a371a97c-e5a2-4a78-a81b-dd257e6a7d6d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:48 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Attempting download of 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 0133e477-7eec-4f15-970d-dd14ee9e8709. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:15:48 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b Sep 28 18:15:48 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[931faa4a-b91a-4373-8c84-f56663153ba3]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:48 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x Sep 28 18:15:48 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:49 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x" returned: 0 in 0.526s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:49 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b" returned: 0 in 1.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1824f4-213a-4b67-89d4-41c8b96917f8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:49 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x Sep 28 18:15:49 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:49 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:49 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:49 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x" returned: 1 in 0.480s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_fyz67c_x' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[67495660-3fe3-4d39-a849-36ae1455ac52]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:49 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD Sep 28 18:15:49 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:49 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.599s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b Sep 28 18:15:50 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:50 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:50 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:15:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 Sep 28 18:15:50 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:50 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b" returned: 0 in 0.832s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b Sep 28 18:15:50 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:51 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.13e109ab-d876-419f-b5fe-2b622ec6166b" returned: 0 in 0.440s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-13e109ab-d876-419f-b5fe-2b622ec6166b" released by "_delete_snapshot" :: held 3.144s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_snapshot" :: held 3.190s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:51 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Created reservations ['3ffeba71-a0f9-4658-8555-555df2ceb922', 'f5c048d2-aee6-4706-82d9-81e9ee22bd6b', '12312629-c12e-4ac1-a0f8-c6f8e0d02237', 'f4732124-b7db-40d6-b3f5-54e6b5240956'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Delete snapshot completed successfully. Sep 28 18:15:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07f6214a-e753-4ac9-b1cf-24b5248910ea tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-13e109ab-d876-419f-b5fe-2b622ec6166b-delete_snapshot" released by "delete_snapshot" :: held 3.449s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Creating offline snapshot 4475071f-3a5a-451c-811a-c1ae549377bd of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec6a77f-9a30-4aba-90c1-d38f6609c3df]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:54 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:15:54 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:54 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709" returned: 0 in 4.326s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:54 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_zf1t8s18devstack@QuobyteHD, size 112.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:15:54 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Converted 112.00 MB image at 25.87 MB/s Sep 28 18:15:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:54 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1G Sep 28 18:15:54 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:55 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 1.216s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:55 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd 1G Sep 28 18:15:55 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:55 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 1G" returned: 0 in 0.704s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Downloaded image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 0133e477-7eec-4f15-970d-dd14ee9e8709 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 for user cec2c2d5c509422280348e7b27e691c4 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Marking volume 0133e477-7eec-4f15-970d-dd14ee9e8709 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Copying metadata from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 to 0133e477-7eec-4f15-970d-dd14ee9e8709. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Creating volume glance metadata for volume 0133e477-7eec-4f15-970d-dd14ee9e8709 backed by image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c852fa-c54d-41ac-a528-78d9f786ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0133e477-7eec-4f15-970d-dd14ee9e8709', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f549ef5-30e5-4199-9c26-8761a682fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Volume volume-0133e477-7eec-4f15-970d-dd14ee9e8709 (0133e477-7eec-4f15-970d-dd14ee9e8709): created successfully Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f549ef5-30e5-4199-9c26-8761a682fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Flow 'volume_create_manager' (fad9e190-7f24-4bbe-a7f2-2511b165ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fb6f3510-8eb3-41c4-a878-2c44dda732d6 tempest-ServerActionsTestOtherA-350002319 None] Created volume successfully. Sep 28 18:15:56 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd 1G" returned: 0 in 0.986s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:56 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd Sep 28 18:15:56 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:56 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd" returned: 0 in 0.859s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:56 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd is being set with open permissions: ugo+rw Sep 28 18:15:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:57 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd Sep 28 18:15:57 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:57 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd" returned: 0 in 0.693s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.311s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ffc3adaa-bc65-453a-bd8f-3578c306d673 tempest-SnapshotsActionsTest-1064894849 None] Create snapshot completed successfully Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-4475071f-3a5a-451c-811a-c1ae549377bd-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-4475071f-3a5a-451c-811a-c1ae549377bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Acquiring lock "cinder-quobyte-4475071f-3a5a-451c-811a-c1ae549377bd" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-4475071f-3a5a-451c-811a-c1ae549377bd" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Deleting offline snapshot 4475071f-3a5a-451c-811a-c1ae549377bd of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] snapshot_file for this snap is: volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc336472-b98b-4409-9699-390a24a73683]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:16:00 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd Sep 28 18:16:00 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.874s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:00 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd" returned: 0 in 1.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 28 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[102b790a-febc-4e71-9d91-2b27fd7ff3e2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:01 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:16:01 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:02 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 1.269s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:16:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:02 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd Sep 28 18:16:02 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:03 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd" returned: 0 in 0.814s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:03 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd Sep 28 18:16:03 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Flow 'volume_create_manager' (41d482b8-87ed-48ec-b573-2d1af4dbb21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61d2a41-16d5-4702-b1f8-20e61c79ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61d2a41-16d5-4702-b1f8-20e61c79ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1621228824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a82a383-0a22-4946-ba58-f57e85732d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa7b7ea9d614a8888a31c65be61d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:03Z,use_quota=True,user_id='c12962e4b2b046a088740a5e9cb1961e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c90e92-3be2-439d-8f37-f4a90ef6e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c90e92-3be2-439d-8f37-f4a90ef6e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33bc58-97e2-4621-a40b-84504d7cf53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33bc58-97e2-4621-a40b-84504d7cf53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a82a383-0a22-4946-ba58-f57e85732d48', 'volume_name': 'volume-9a82a383-0a22-4946-ba58-f57e85732d48', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182eb1b4-cf51-4c18-8187-4f752c140ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182eb1b4-cf51-4c18-8187-4f752c140ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d548f68-4abd-4ab1-95fa-0f501e206909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Volume 9a82a383-0a22-4946-ba58-f57e85732d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a82a383-0a22-4946-ba58-f57e85732d48', 'volume_size': 1} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1621228824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a82a383-0a22-4946-ba58-f57e85732d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa7b7ea9d614a8888a31c65be61d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:03Z,use_quota=True,user_id='c12962e4b2b046a088740a5e9cb1961e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Creating volume 9a82a383-0a22-4946-ba58-f57e85732d48 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:16:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:03 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 1073741824 Sep 28 18:16:03 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:04 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.4475071f-3a5a-451c-811a-c1ae549377bd" returned: 0 in 0.857s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-4475071f-3a5a-451c-811a-c1ae549377bd" released by "_delete_snapshot" :: held 4.338s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_snapshot" :: held 4.423s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Created reservations ['a6b6765a-10fb-428e-94db-ce18fe8cff90', 'f9acc067-102f-4d62-9275-8da78599f265', '5772bf9b-d4f1-4eef-85bf-50d6ec4c01c7', '60fbd7c5-8a11-49ff-b1d5-1533c8d25ac1'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Delete snapshot completed successfully. Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9dcff64-3d30-425f-b7c9-15e0d7c2c611 tempest-SnapshotsActionsTest-311062275 None] Lock "cinder-4475071f-3a5a-451c-811a-c1ae549377bd-delete_snapshot" released by "delete_snapshot" :: held 5.017s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b500edd3-965b-4e50-a2bc-b70f76849b6b req-123ae782-d6b1-4bdc-9a27-510610c29f31 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:05 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 1073741824" returned: 0 in 1.494s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:05 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 Sep 28 18:16:05 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:05 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48" returned: 0 in 0.868s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] <== create_volume: return (2485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b500edd3-965b-4e50-a2bc-b70f76849b6b req-123ae782-d6b1-4bdc-9a27-510610c29f31 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.068s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b500edd3-965b-4e50-a2bc-b70f76849b6b req-123ae782-d6b1-4bdc-9a27-510610c29f31 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d548f68-4abd-4ab1-95fa-0f501e206909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a82a383-0a22-4946-ba58-f57e85732d48', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1dd061-d3f6-4496-8f94-555c75f6043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Volume volume-9a82a383-0a22-4946-ba58-f57e85732d48 (9a82a383-0a22-4946-ba58-f57e85732d48): created successfully Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1dd061-d3f6-4496-8f94-555c75f6043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Flow 'volume_create_manager' (41d482b8-87ed-48ec-b573-2d1af4dbb21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-84981fe4-0990-4f6f-8d97-3abb82d86ebf tempest-DeleteServersTestJSON-1088473102 None] Created volume successfully. Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-b500edd3-965b-4e50-a2bc-b70f76849b6b req-123ae782-d6b1-4bdc-9a27-510610c29f31 tempest-ServerActionsTestOtherA-350002319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-0133e477-7eec-4f15-970d-dd14ee9e8709', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c27b1a8-91b7-4f74-bda1-3ec70745e854', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-b500edd3-965b-4e50-a2bc-b70f76849b6b req-123ae782-d6b1-4bdc-9a27-510610c29f31 tempest-ServerActionsTestOtherA-350002319 None] attachment_update completed successfully. Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "cinder-c5524628-ef1a-4161-85e1-d394bd4e2480-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-c5524628-ef1a-4161-85e1-d394bd4e2480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "cinder-quobyte-c5524628-ef1a-4161-85e1-d394bd4e2480" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-c5524628-ef1a-4161-85e1-d394bd4e2480" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Deleting offline snapshot c5524628-ef1a-4161-85e1-d394bd4e2480 of volume ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:16:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] snapshot_file for this snap is: volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:16:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec477b-20f5-490f-b727-76f3d5b528ae]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:07 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:16:07 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:08 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 1.141s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee22810b-6138-4dc8-b270-686b879bd6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cade91-266f-4e30-9ad9-fab6d450dec3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:08 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc Sep 28 18:16:08 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f787fd89-d073-425a-b932-13a4c92b0741 req-5bff85ee-da0d-49c3-ab86-8a166863ff74 tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f787fd89-d073-425a-b932-13a4c92b0741 req-5bff85ee-da0d-49c3-ab86-8a166863ff74 tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f787fd89-d073-425a-b932-13a4c92b0741 req-5bff85ee-da0d-49c3-ab86-8a166863ff74 tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.090s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-f787fd89-d073-425a-b932-13a4c92b0741 req-5bff85ee-da0d-49c3-ab86-8a166863ff74 tempest-DeleteServersTestJSON-1088473102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-9a82a383-0a22-4946-ba58-f57e85732d48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'affebf62-c1f1-497a-bfaf-515cfa94316f', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:09 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc" returned: 0 in 1.041s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:09 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:16:09 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-f787fd89-d073-425a-b932-13a4c92b0741 req-5bff85ee-da0d-49c3-ab86-8a166863ff74 tempest-DeleteServersTestJSON-1088473102 None] attachment_update completed successfully. Sep 28 18:16:10 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 1.155s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:10 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480 Sep 28 18:16:10 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:11 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc.c5524628-ef1a-4161-85e1-d394bd4e2480" returned: 0 in 0.843s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-c5524628-ef1a-4161-85e1-d394bd4e2480" released by "_delete_snapshot" :: held 4.486s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_snapshot" :: held 4.559s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:11 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Created reservations ['fab40320-1a3f-4e1b-8338-a24f5f619a64', 'd0f26a48-716c-48a1-a3c9-59d852280bc6', '893de65f-7470-4834-a0fd-07cc029e2a15', 'b2c38c3a-479d-4894-bbfa-dd98a9b22714'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Delete snapshot completed successfully. Sep 28 18:16:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8652ee05-c888-4cdc-a6e5-55cecf379b41 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-c5524628-ef1a-4161-85e1-d394bd4e2480-delete_snapshot" released by "delete_snapshot" :: held 4.944s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "cinder-ee22810b-6138-4dc8-b270-686b879bd6fc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-ee22810b-6138-4dc8-b270-686b879bd6fc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" acquired by "delete_volume" :: waited 0.068s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b8311-ecca-4fa8-a470-e2a0f038384e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:13 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc Sep 28 18:16:13 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:14 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc" returned: 0 in 1.113s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:14 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc Sep 28 18:16:14 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:15 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ee22810b-6138-4dc8-b270-686b879bd6fc" returned: 0 in 0.843s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-quobyte-ee22810b-6138-4dc8-b270-686b879bd6fc" released by "delete_volume" :: held 2.229s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Created reservations ['a41fca16-a9cc-4c73-ae53-74c3ef809bd5', '1a30b330-6c76-419d-9a7a-1b64fd6d6f48', '2c4cf05f-2363-4e11-b745-68c50dbf524e', '5a064f68-e33c-4d5f-928e-7c659785eb8a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:15 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:16:15 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:15 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:16 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Deleted volume successfully. Sep 28 18:16:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bc3ede4-595b-4b79-ac1f-affd1d4b2249 tempest-SnapshotsActionsTest-1064894849 None] Lock "cinder-ee22810b-6138-4dc8-b270-686b879bd6fc-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-92b77fa2-b2b5-4575-a3d5-13144fa933e2 req-05178069-8009-4341-81ee-0affb05c6502 tempest-DeleteServersTestJSON-1088473102 None] Terminate volume connection completed successfully. Sep 28 18:16:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-92b77fa2-b2b5-4575-a3d5-13144fa933e2 req-05178069-8009-4341-81ee-0affb05c6502 tempest-DeleteServersTestJSON-1088473102 None] Deleting attachment affebf62-c1f1-497a-bfaf-515cfa94316f. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=64,cinder:SELECT=71,cinder:INSERT=24,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=72,cinder:UPDATE=47,cinder:DELETE=8,cinder:INSERT=17 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Flow 'volume_create_manager' (57e40e39-3ba8-48ed-9f38-516eef552bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661c278d-31e7-484e-bcec-2211956c050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661c278d-31e7-484e-bcec-2211956c050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415502019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8f7472-799f-47f8-afcb-ddc605194137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39d563ef3bf4bba9fc39da26db43f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:20Z,use_quota=True,user_id='2c8c283f04dc4926b2ed280ab5869ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb1928b-ef6d-4397-85c0-443298a6f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb1928b-ef6d-4397-85c0-443298a6f67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7826bc-f769-4619-a765-58db415868c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7826bc-f769-4619-a765-58db415868c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8f7472-799f-47f8-afcb-ddc605194137', 'volume_name': 'volume-fb8f7472-799f-47f8-afcb-ddc605194137', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b956a-d1a4-47a6-8af1-896677966b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b956a-d1a4-47a6-8af1-896677966b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81896fa9-2d79-4f70-983f-57c49de95901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Volume fb8f7472-799f-47f8-afcb-ddc605194137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8f7472-799f-47f8-afcb-ddc605194137', 'volume_size': 1} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415502019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8f7472-799f-47f8-afcb-ddc605194137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39d563ef3bf4bba9fc39da26db43f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:20Z,use_quota=True,user_id='2c8c283f04dc4926b2ed280ab5869ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Creating volume fb8f7472-799f-47f8-afcb-ddc605194137 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:20 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:16:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:20 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 1073741824 Sep 28 18:16:20 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:21 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 1073741824" returned: 0 in 1.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:21 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 Sep 28 18:16:21 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:22 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137" returned: 0 in 0.623s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81896fa9-2d79-4f70-983f-57c49de95901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8f7472-799f-47f8-afcb-ddc605194137', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf517f83-b359-4062-92bd-a4189b318044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "cinder-9a82a383-0a22-4946-ba58-f57e85732d48-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Volume volume-fb8f7472-799f-47f8-afcb-ddc605194137 (fb8f7472-799f-47f8-afcb-ddc605194137): created successfully Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf517f83-b359-4062-92bd-a4189b318044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Flow 'volume_create_manager' (57e40e39-3ba8-48ed-9f38-516eef552bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "cinder-9a82a383-0a22-4946-ba58-f57e85732d48-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a3f40bd0-80b4-46b2-b0ed-b6b84ae14e9d tempest-ServersNegativeTestJSON-676222907 None] Created volume successfully. Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "cinder-quobyte-9a82a383-0a22-4946-ba58-f57e85732d48" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "cinder-quobyte-9a82a383-0a22-4946-ba58-f57e85732d48" acquired by "delete_volume" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7442617-fd9a-430f-8c04-f81c260a829b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:23 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 Sep 28 18:16:23 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:23 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48" returned: 0 in 0.687s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:23 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48 Sep 28 18:16:23 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a82a383-0a22-4946-ba58-f57e85732d48" returned: 0 in 0.809s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "cinder-quobyte-9a82a383-0a22-4946-ba58-f57e85732d48" released by "delete_volume" :: held 1.621s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Created reservations ['3bc747ab-ad54-4f07-b834-180a1e462b17', '49016506-6895-41f0-a6fa-62f724eb875f', 'e683e091-4add-4252-8581-e5c6bcd908f4', '4a613822-ab69-43e5-9696-2feadd22463b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:24 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:16:24 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:25 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.531s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:25 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:25 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Deleted volume successfully. Sep 28 18:16:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b782422a-0cbb-4ecb-ae26-a53f8658dcef tempest-DeleteServersTestJSON-1088473102 None] Lock "cinder-9a82a383-0a22-4946-ba58-f57e85732d48-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Flow 'volume_create_manager' (416cdec5-2055-4b27-81b5-ff19aef86c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7b00b7-d17d-46df-b77b-e962f2952cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7b00b7-d17d-46df-b77b-e962f2952cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-332533955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76efeb5f-3a9c-4cfc-9594-022f5795d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39d563ef3bf4bba9fc39da26db43f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:27Z,use_quota=True,user_id='2c8c283f04dc4926b2ed280ab5869ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc23a55-a67d-4b97-8c86-6384cd6a8fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc23a55-a67d-4b97-8c86-6384cd6a8fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461de623-6f56-4a45-803a-6edcd5f211f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461de623-6f56-4a45-803a-6edcd5f211f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76efeb5f-3a9c-4cfc-9594-022f5795d1c8', 'volume_name': 'volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdee8d2-416a-4d57-8afb-8a8851539070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdee8d2-416a-4d57-8afb-8a8851539070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0195a17b-f67f-475b-9594-b06b2c705792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Volume 76efeb5f-3a9c-4cfc-9594-022f5795d1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8', 'volume_size': 1} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-332533955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76efeb5f-3a9c-4cfc-9594-022f5795d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39d563ef3bf4bba9fc39da26db43f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:27Z,use_quota=True,user_id='2c8c283f04dc4926b2ed280ab5869ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Creating volume 76efeb5f-3a9c-4cfc-9594-022f5795d1c8 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:27 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:16:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:27 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 1073741824 Sep 28 18:16:27 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:28 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 1073741824" returned: 0 in 1.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:29 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 Sep 28 18:16:29 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:29 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" returned: 0 in 0.597s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0195a17b-f67f-475b-9594-b06b2c705792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0bade6-4fb4-4d1c-b94b-20827bcb2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Volume volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 (76efeb5f-3a9c-4cfc-9594-022f5795d1c8): created successfully Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0bade6-4fb4-4d1c-b94b-20827bcb2656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Flow 'volume_create_manager' (416cdec5-2055-4b27-81b5-ff19aef86c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1a1489c3-a6a8-4a31-8ce6-3b24f35cd7c9 tempest-ServersNegativeTestJSON-676222907 None] Created volume successfully. Sep 28 18:16:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "cinder-76efeb5f-3a9c-4cfc-9594-022f5795d1c8-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-76efeb5f-3a9c-4cfc-9594-022f5795d1c8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "cinder-quobyte-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-quobyte-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" acquired by "delete_volume" :: waited 0.040s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ed8b5-e471-4972-8943-451ab0c63b47]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:31 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 Sep 28 18:16:31 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:31 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" returned: 0 in 0.656s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:31 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8 Sep 28 18:16:31 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:32 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" returned: 0 in 0.595s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-quobyte-76efeb5f-3a9c-4cfc-9594-022f5795d1c8" released by "delete_volume" :: held 1.342s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Created reservations ['7fdfa9de-b0aa-4255-bcb0-f1b50709ff28', 'b3b103d6-0f82-446e-9b38-a9c8b7ef54cc', '1bae0741-c045-4541-978d-c0b751a67b64', '33058d66-6a9f-4288-a43f-5e4a7722812d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:32 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:16:32 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:32 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:32 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Deleted volume successfully. Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-02a37da8-90f0-46c6-a981-123fe9365262 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-76efeb5f-3a9c-4cfc-9594-022f5795d1c8-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "cinder-fb8f7472-799f-47f8-afcb-ddc605194137-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-fb8f7472-799f-47f8-afcb-ddc605194137-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "cinder-quobyte-fb8f7472-799f-47f8-afcb-ddc605194137" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-quobyte-fb8f7472-799f-47f8-afcb-ddc605194137" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9bd98-e7dc-4583-aa9a-c770618ed048]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:33 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 Sep 28 18:16:33 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:34 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137" returned: 0 in 0.455s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:34 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137 Sep 28 18:16:34 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:34 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fb8f7472-799f-47f8-afcb-ddc605194137" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-quobyte-fb8f7472-799f-47f8-afcb-ddc605194137" released by "delete_volume" :: held 0.936s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Created reservations ['07137a64-89a6-47ac-84cd-cf93f1a97532', '1f356ddd-5f5d-4535-8511-e8f3b8132c3b', '07764e58-77b2-4ed3-b010-0702e8c343f3', '88e86870-8c23-410f-9ad7-fd73d497dcbd'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:35 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:16:35 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:35 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.672s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Deleted volume successfully. Sep 28 18:16:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e9039073-dd19-4b58-9e33-eb208cb26431 tempest-ServersNegativeTestJSON-676222907 None] Lock "cinder-fb8f7472-799f-47f8-afcb-ddc605194137-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-daa320e7-79ab-4959-8a14-99eb597da0d6 tempest-ServerActionsTestOtherA-350002319 None] Terminate volume connection completed successfully. Sep 28 18:16:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-daa320e7-79ab-4959-8a14-99eb597da0d6 tempest-ServerActionsTestOtherA-350002319 None] Deleting attachment 7c27b1a8-91b7-4f74-bda1-3ec70745e854. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:45 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=17,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:49 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=8 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-32385ab9-9e1d-4a12-8e05-a1992b6e2a64 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-32385ab9-9e1d-4a12-8e05-a1992b6e2a64 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-32385ab9-9e1d-4a12-8e05-a1992b6e2a64 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-32385ab9-9e1d-4a12-8e05-a1992b6e2a64 tempest-ServerActionsTestOtherA-350002319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-0133e477-7eec-4f15-970d-dd14ee9e8709', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47a4db4b-52bb-4143-872e-f5bc25ae77fe', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-b4775dce-6d55-44c5-8ec3-b7b77164ea82 req-32385ab9-9e1d-4a12-8e05-a1992b6e2a64 tempest-ServerActionsTestOtherA-350002319 None] attachment_update completed successfully. Sep 28 18:16:55 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Flow 'volume_create_manager' (d6f3c07b-55c7-4010-ace7-91a8302dcbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71e4ab0-f1bd-41e9-adf6-fcd2b2a82db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71e4ab0-f1bd-41e9-adf6-fcd2b2a82db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1821386322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bba91b-46c9-4d97-af8d-91898c846b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d914dc564f44e3683316925d233d5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:56Z,use_quota=True,user_id='494e99abf5584ea589ba8edca1abd836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950b774e-6e7a-431d-931e-802e03fb9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950b774e-6e7a-431d-931e-802e03fb9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a8024-6675-4f30-a1d1-db4e943ac2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a8024-6675-4f30-a1d1-db4e943ac2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06bba91b-46c9-4d97-af8d-91898c846b6d', 'volume_name': 'volume-06bba91b-46c9-4d97-af8d-91898c846b6d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a18697a-b2da-4062-901a-209ecbaaca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a18697a-b2da-4062-901a-209ecbaaca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0c71f-b1fa-479c-9b13-4b9885e15f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Volume 06bba91b-46c9-4d97-af8d-91898c846b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06bba91b-46c9-4d97-af8d-91898c846b6d', 'volume_size': 1} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1821386322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bba91b-46c9-4d97-af8d-91898c846b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d914dc564f44e3683316925d233d5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:56Z,use_quota=True,user_id='494e99abf5584ea589ba8edca1abd836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Creating volume 06bba91b-46c9-4d97-af8d-91898c846b6d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:56 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:56 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d 1073741824 Sep 28 18:16:56 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:56 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d 1073741824" returned: 0 in 0.868s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d Sep 28 18:16:57 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:57 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d" returned: 0 in 0.570s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0c71f-b1fa-479c-9b13-4b9885e15f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06bba91b-46c9-4d97-af8d-91898c846b6d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f449145-ac1f-4007-98a2-d6b57b6bde2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Volume volume-06bba91b-46c9-4d97-af8d-91898c846b6d (06bba91b-46c9-4d97-af8d-91898c846b6d): created successfully Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f449145-ac1f-4007-98a2-d6b57b6bde2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Flow 'volume_create_manager' (d6f3c07b-55c7-4010-ace7-91a8302dcbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4662b833-c3fe-40a9-9759-1aac2ac25b48 tempest-VolumeQuotasNegativeTestJSON-202904087 None] Created volume successfully. Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:00 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:17:00 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:00 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.777s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 28 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:17:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Acquiring lock "cinder-06bba91b-46c9-4d97-af8d-91898c846b6d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "cinder-06bba91b-46c9-4d97-af8d-91898c846b6d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Acquiring lock "cinder-quobyte-06bba91b-46c9-4d97-af8d-91898c846b6d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "cinder-quobyte-06bba91b-46c9-4d97-af8d-91898c846b6d" acquired by "delete_volume" :: waited 0.048s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6781e9-c5f2-40a9-94a6-6e297e2c66e8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:01 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d Sep 28 18:17:01 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:02 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d" returned: 0 in 0.974s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:02 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d Sep 28 18:17:02 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:02 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-06bba91b-46c9-4d97-af8d-91898c846b6d" returned: 0 in 0.530s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "cinder-quobyte-06bba91b-46c9-4d97-af8d-91898c846b6d" released by "delete_volume" :: held 1.622s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Created reservations ['dab52ddc-0966-4c86-b529-a98a27a5dfec', '36cec0c2-2015-4f05-8498-34c029ecf5e2', '9ba789cb-3ede-4363-ab56-7750eece183b', '7d6f961d-d8b3-4f4d-a486-f72031ee954e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:03 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:17:03 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:04 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.517s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:04 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Deleted volume successfully. Sep 28 18:17:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-91791117-8482-4132-b4f4-2e54935860db tempest-VolumeQuotasNegativeTestJSON-202904087 None] Lock "cinder-06bba91b-46c9-4d97-af8d-91898c846b6d-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:13 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:14 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-e4802d2d-83c0-4f4d-bad0-c1e8a43923e2 tempest-ServerActionsTestOtherA-350002319 None] Terminate volume connection completed successfully. Sep 28 18:17:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-e4802d2d-83c0-4f4d-bad0-c1e8a43923e2 tempest-ServerActionsTestOtherA-350002319 None] Deleting attachment 47a4db4b-52bb-4143-872e-f5bc25ae77fe. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:17:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "cinder-0133e477-7eec-4f15-970d-dd14ee9e8709-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-0133e477-7eec-4f15-970d-dd14ee9e8709-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "cinder-quobyte-0133e477-7eec-4f15-970d-dd14ee9e8709" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-quobyte-0133e477-7eec-4f15-970d-dd14ee9e8709" acquired by "delete_volume" :: waited 0.076s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3661b118-9d33-46f8-895c-9bcd4949a4f2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:37 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 Sep 28 18:17:37 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709" returned: 0 in 0.947s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:38 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709 Sep 28 18:17:38 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0133e477-7eec-4f15-970d-dd14ee9e8709" returned: 0 in 0.540s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-quobyte-0133e477-7eec-4f15-970d-dd14ee9e8709" released by "delete_volume" :: held 1.643s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:38 devstack cinder-volume[86560]: DEBUG cinder.quota [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Created reservations ['f147a255-a267-46fc-af2a-c63aa1767d11', 'e85d9b49-f4e0-40ef-9f3a-b81ab8c4c015', '762417bd-90f9-446c-99c7-fa516fc2cbd3', '0ee6b6f9-a5ee-4f30-b84a-c231b5c0d08a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:39 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:17:39 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:39 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.manager [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Deleted volume successfully. Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-eeaa83cf-5ae5-4375-bdf6-4b7f0f2ffb3b req-7559d389-6b5e-45b4-b4ed-fef9f37cbd49 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-0133e477-7eec-4f15-970d-dd14ee9e8709-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "cinder-7b0a069a-3211-4e96-964a-c681358c1764-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-7b0a069a-3211-4e96-964a-c681358c1764-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "cinder-quobyte-7b0a069a-3211-4e96-964a-c681358c1764" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-quobyte-7b0a069a-3211-4e96-964a-c681358c1764" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a903fe84-3ca2-4f84-a47b-e652692ccf5b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:39 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 Sep 28 18:17:40 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:40 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764" returned: 0 in 0.548s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:40 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764 Sep 28 18:17:40 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:40 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7b0a069a-3211-4e96-964a-c681358c1764" returned: 0 in 0.434s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-quobyte-7b0a069a-3211-4e96-964a-c681358c1764" released by "delete_volume" :: held 1.057s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:40 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Created reservations ['f40628b7-f099-4e71-b916-6793e8603019', 'b3e39b54-b0f4-4325-b019-ece4b22c6de7', 'f33c41a8-c53a-4199-923b-5072e9f905d7', '6a1e95f5-9329-4c1e-b622-38434b5e13ad'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:17:41 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.361s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Deleted volume successfully. Sep 28 18:17:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3b81f316-610e-43c2-ac75-6fa1c4647260 tempest-ServerActionsTestOtherA-350002319 None] Lock "cinder-7b0a069a-3211-4e96-964a-c681358c1764-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Flow 'volume_create_manager' (2189df5a-863e-47e1-b70c-42d414b316ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2fd438-72cb-4314-b4b4-71e09057d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2fd438-72cb-4314-b4b4-71e09057d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1181963479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068cce68-09a5-42b0-9331-c8c11b28939e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da185d5ddf841da872205ac8a0e6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:49Z,use_quota=True,user_id='b059e8e136a44e97ba25ecb18258ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fd6668-b098-4d16-8a9f-81a99a692976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fd6668-b098-4d16-8a9f-81a99a692976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ddac5-d81f-473c-a01d-f0f8a41d7a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ddac5-d81f-473c-a01d-f0f8a41d7a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068cce68-09a5-42b0-9331-c8c11b28939e', 'volume_name': 'volume-068cce68-09a5-42b0-9331-c8c11b28939e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf2fb5-1631-4f65-b499-d605d7660f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf2fb5-1631-4f65-b499-d605d7660f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b77e1a1-67ee-41c8-92c3-d8cdea99a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Volume 068cce68-09a5-42b0-9331-c8c11b28939e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068cce68-09a5-42b0-9331-c8c11b28939e', 'volume_size': 1} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1181963479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068cce68-09a5-42b0-9331-c8c11b28939e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da185d5ddf841da872205ac8a0e6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:49Z,use_quota=True,user_id='b059e8e136a44e97ba25ecb18258ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Creating volume 068cce68-09a5-42b0-9331-c8c11b28939e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:49 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:17:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:49 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e 1073741824 Sep 28 18:17:49 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:50 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e 1073741824" returned: 0 in 0.797s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:50 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e Sep 28 18:17:50 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:50 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e" returned: 0 in 0.287s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b77e1a1-67ee-41c8-92c3-d8cdea99a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068cce68-09a5-42b0-9331-c8c11b28939e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447f170-24e3-41b2-8c9b-f63aa20fefce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Volume volume-068cce68-09a5-42b0-9331-c8c11b28939e (068cce68-09a5-42b0-9331-c8c11b28939e): created successfully Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447f170-24e3-41b2-8c9b-f63aa20fefce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Flow 'volume_create_manager' (2189df5a-863e-47e1-b70c-42d414b316ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e4b5ffba-834f-40c7-895b-b99d9d046af5 tempest-AttachVolumeShelveTestJSON-853469424 None] Created volume successfully. Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:00 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:18:00 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=21,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:00 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.493s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 28 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:18:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:18:01 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (4b00ef58-0740-4a2b-b7cc-ca2a2f37c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdf1c13-2b83-4555-a3ec-ed5212951e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdf1c13-2b83-4555-a3ec-ed5212951e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1529873601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aff0fc6-94c2-40f7-ac55-3e1441c96feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:02Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffa97dd-c17c-4796-b836-a64dce94452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffa97dd-c17c-4796-b836-a64dce94452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c970d0af-06d9-4101-af15-5883d9879f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c970d0af-06d9-4101-af15-5883d9879f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aff0fc6-94c2-40f7-ac55-3e1441c96feb', 'volume_name': 'volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede3077-18f2-4d04-bac1-9bdeb5f11f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede3077-18f2-4d04-bac1-9bdeb5f11f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df305e5c-49db-423c-a56d-c1633deb1606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Volume 7aff0fc6-94c2-40f7-ac55-3e1441c96feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb', 'volume_size': 1} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1529873601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aff0fc6-94c2-40f7-ac55-3e1441c96feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:02Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Creating volume 7aff0fc6-94c2-40f7-ac55-3e1441c96feb {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:02 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:02 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb 1073741824 Sep 28 18:18:02 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:02 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb 1073741824" returned: 0 in 0.813s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:03 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb Sep 28 18:18:03 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Flow 'volume_create_manager' (0cabfe0b-cb75-46cd-a232-30712dbe8350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cdc8a1-c8c8-4988-b84a-5df310310308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cdc8a1-c8c8-4988-b84a-5df310310308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-947230670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670ad093-7d25-4954-903a-14b8026cdd45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e54392d2c40f5948ff80f817ad132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:03Z,use_quota=True,user_id='0ce06cb8be3946d8850f59a9b54b7ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71860d37-38b9-46f7-8a4a-f8e3077e53a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71860d37-38b9-46f7-8a4a-f8e3077e53a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea0e270-64b8-40fa-a7fd-0201968c231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea0e270-64b8-40fa-a7fd-0201968c231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670ad093-7d25-4954-903a-14b8026cdd45', 'volume_name': 'volume-670ad093-7d25-4954-903a-14b8026cdd45', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b30fc6e-1855-4ec4-9d59-cc9596691dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b30fc6e-1855-4ec4-9d59-cc9596691dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c70c3-1d04-4a25-a1aa-058ac5fd5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Volume 670ad093-7d25-4954-903a-14b8026cdd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670ad093-7d25-4954-903a-14b8026cdd45', 'volume_size': 1} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" returned: 0 in 0.531s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-947230670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670ad093-7d25-4954-903a-14b8026cdd45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e54392d2c40f5948ff80f817ad132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:03Z,use_quota=True,user_id='0ce06cb8be3946d8850f59a9b54b7ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Creating volume 670ad093-7d25-4954-903a-14b8026cdd45 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:03 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 1073741824 Sep 28 18:18:03 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df305e5c-49db-423c-a56d-c1633deb1606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4041f5c8-1ec4-43d3-be80-cb08464a061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Volume volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb (7aff0fc6-94c2-40f7-ac55-3e1441c96feb): created successfully Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4041f5c8-1ec4-43d3-be80-cb08464a061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (4b00ef58-0740-4a2b-b7cc-ca2a2f37c198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2e15f33f-3e8e-45be-9bd4-372c472b8d15 tempest-AttachVolumeTestJSON-407998149 None] Created volume successfully. Sep 28 18:18:04 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 1073741824" returned: 0 in 0.622s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:04 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 Sep 28 18:18:04 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:04 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c70c3-1d04-4a25-a1aa-058ac5fd5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670ad093-7d25-4954-903a-14b8026cdd45', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8cf3fb-451d-4f52-9fa5-8d365f19ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Volume volume-670ad093-7d25-4954-903a-14b8026cdd45 (670ad093-7d25-4954-903a-14b8026cdd45): created successfully Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8cf3fb-451d-4f52-9fa5-8d365f19ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Flow 'volume_create_manager' (0cabfe0b-cb75-46cd-a232-30712dbe8350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-9c5ebb66-e257-4c8f-ad01-a651d9dbccbe req-cfa4b795-3937-4f96-a9d8-2082a80323bf tempest-VolumesGetTestJSON-304945308 None] Created volume successfully. Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5d4e15c3-2f46-4a51-8b6c-dd66cf9d49ac req-e5cdbd32-5a25-4037-b1c7-06458980ca23 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5d4e15c3-2f46-4a51-8b6c-dd66cf9d49ac req-e5cdbd32-5a25-4037-b1c7-06458980ca23 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5d4e15c3-2f46-4a51-8b6c-dd66cf9d49ac req-e5cdbd32-5a25-4037-b1c7-06458980ca23 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5d4e15c3-2f46-4a51-8b6c-dd66cf9d49ac req-e5cdbd32-5a25-4037-b1c7-06458980ca23 tempest-AttachVolumeTestJSON-407998149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '950790b0-75c2-4208-ba37-0cb6eb05ee51', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5d4e15c3-2f46-4a51-8b6c-dd66cf9d49ac req-e5cdbd32-5a25-4037-b1c7-06458980ca23 tempest-AttachVolumeTestJSON-407998149 None] attachment_update completed successfully. Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-c74c09c2-4a3b-4f76-91e1-e782ce17ae24 req-732f3e36-ebd2-4677-99d6-c11bca79991d tempest-AttachVolumeShelveTestJSON-853469424 None] No connector for attachment 7de684f8-e19b-474c-bf96-56432e40c2e8; skipping storage backend terminate_connection call. {{(pid=86560) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 18:18:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-c74c09c2-4a3b-4f76-91e1-e782ce17ae24 req-732f3e36-ebd2-4677-99d6-c11bca79991d tempest-AttachVolumeShelveTestJSON-853469424 None] Deleting attachment 7de684f8-e19b-474c-bf96-56432e40c2e8. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Acquiring lock "cinder-670ad093-7d25-4954-903a-14b8026cdd45-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "cinder-670ad093-7d25-4954-903a-14b8026cdd45-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Acquiring lock "cinder-quobyte-670ad093-7d25-4954-903a-14b8026cdd45" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "cinder-quobyte-670ad093-7d25-4954-903a-14b8026cdd45" acquired by "delete_volume" :: waited 0.054s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c71a8-22ea-4ca1-9077-816f601440e9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:06 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 Sep 28 18:18:06 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:07 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45" returned: 0 in 0.598s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:07 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45 Sep 28 18:18:07 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:07 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-670ad093-7d25-4954-903a-14b8026cdd45" returned: 0 in 0.597s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "cinder-quobyte-670ad093-7d25-4954-903a-14b8026cdd45" released by "delete_volume" :: held 1.281s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG cinder.quota [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Created reservations ['fcfb0fcc-3c2f-48eb-946a-2ec367567a77', 'b9e1b321-e240-48a6-9815-b88a76ff7654', 'cf066c26-7146-4212-9375-194650754777', 'b11fccd8-90e9-4527-9317-8394637f386a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:08 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:18:08 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:08 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.522s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG cinder.manager [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Deleted volume successfully. Sep 28 18:18:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-cae8e056-eb71-4a3d-8d9b-17c4326787a5 req-f734e531-302e-4a3e-a829-70b7f69ed46a tempest-VolumesGetTestJSON-304945308 None] Lock "cinder-670ad093-7d25-4954-903a-14b8026cdd45-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:18 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:18 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=19,cinder:UPDATE=15,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (3c064ead-ab45-403e-b706-9d0d027139db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178823f-9dd0-4483-943f-470936840eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178823f-9dd0-4483-943f-470936840eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-174298856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa2d0c5-e8bd-48a1-8533-bfdcc497208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:39Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b150e3f-d478-4893-a521-e74b504ef9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b150e3f-d478-4893-a521-e74b504ef9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532d1c00-80d3-4b23-b3f8-5882957635e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532d1c00-80d3-4b23-b3f8-5882957635e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa2d0c5-e8bd-48a1-8533-bfdcc497208c', 'volume_name': 'volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf6c10-d1bc-405c-8813-e6b9062e2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf6c10-d1bc-405c-8813-e6b9062e2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13ed39-88f5-4e8e-a028-70a192efa976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Volume 8fa2d0c5-e8bd-48a1-8533-bfdcc497208c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c', 'volume_size': 1} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-174298856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa2d0c5-e8bd-48a1-8533-bfdcc497208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:39Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Creating volume 8fa2d0c5-e8bd-48a1-8533-bfdcc497208c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:38 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:18:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:38 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c 1073741824 Sep 28 18:18:38 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:39 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c 1073741824" returned: 0 in 1.067s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:40 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c Sep 28 18:18:40 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:40 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" returned: 0 in 0.696s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13ed39-88f5-4e8e-a028-70a192efa976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f236f78-c8b9-4627-853d-73349245de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Volume volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c (8fa2d0c5-e8bd-48a1-8533-bfdcc497208c): created successfully Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f236f78-c8b9-4627-853d-73349245de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (3c064ead-ab45-403e-b706-9d0d027139db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6c5d66b0-6764-4cb3-8c43-a4ae47152830 tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:18:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8b095a86-5198-4898-9725-df66b6e19c4e tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" by "attach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8b095a86-5198-4898-9725-df66b6e19c4e tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" acquired by "attach_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8b095a86-5198-4898-9725-df66b6e19c4e tempest-VolumesActionsTest-682578736 None] Attaching volume 8fa2d0c5-e8bd-48a1-8533-bfdcc497208c to instance b62e8e35-087d-4305-8e32-ef306d1ecd3a at mountpoint /dev/vdb on host None. Sep 28 18:18:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8b095a86-5198-4898-9725-df66b6e19c4e tempest-VolumesActionsTest-682578736 None] Attach volume completed successfully. Sep 28 18:18:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8b095a86-5198-4898-9725-df66b6e19c4e tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" released by "attach_volume" :: held 0.177s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Terminate volume connection completed successfully. Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" by "detach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Detaching volume 8fa2d0c5-e8bd-48a1-8533-bfdcc497208c from instance b62e8e35-087d-4305-8e32-ef306d1ecd3a. Sep 28 18:18:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Detach volume completed successfully. Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-44521332-71b6-4b55-9537-e3d84ef7beee tempest-VolumesActionsTest-100115430 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-33c3d0da-e78a-417d-8306-65673215fcfd tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" by "detach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-33c3d0da-e78a-417d-8306-65673215fcfd tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-33c3d0da-e78a-417d-8306-65673215fcfd tempest-VolumesActionsTest-682578736 None] Volume detach called, but volume not attached. Sep 28 18:18:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-33c3d0da-e78a-417d-8306-65673215fcfd tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-quobyte-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "cinder-quobyte-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc32b582-fda5-4070-914b-65c315d009d1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:43 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c Sep 28 18:18:43 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:44 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" returned: 0 in 0.650s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:44 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c Sep 28 18:18:44 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:44 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" returned: 0 in 0.601s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "cinder-quobyte-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c" released by "delete_volume" :: held 1.362s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3e7245c3-fd39-403d-abe6-299bbdacf7c1 tempest-GroupsV314Test-92537420 None] Group tempest-GroupsV314Test-Group-1994729374: creating Sep 28 18:18:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3e7245c3-fd39-403d-abe6-299bbdacf7c1 tempest-GroupsV314Test-92537420 None] Group tempest-GroupsV314Test-Group-1994729374: created successfully Sep 28 18:18:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3e7245c3-fd39-403d-abe6-299bbdacf7c1 tempest-GroupsV314Test-92537420 None] Create group completed successfully. Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Created reservations ['9ed9f1b1-7cb0-45d8-ab3b-439cdcfb6ba1', '4d3cef14-a08e-4c5c-85a3-126578dd2b93', '0d9c3c92-a074-4282-bc59-ca695740e773', '6c9f306d-4ad3-458f-8278-2d2af9d993f4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:44 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:18:44 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.331s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Deleted volume successfully. Sep 28 18:18:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2e8c9a1a-2284-49f0-b23a-96a1f501db88 tempest-VolumesActionsTest-682578736 None] Lock "cinder-8fa2d0c5-e8bd-48a1-8533-bfdcc497208c-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Flow 'volume_create_manager' (5fa326b0-df0a-4354-a4bb-975578afec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9d2080-7fc7-435e-bdb8-3efd69ef8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9d2080-7fc7-435e-bdb8-3efd69ef8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353093127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b2e4f0-fcdf-407a-be34-05390a14c4f7,host='devstack@QuobyteHD#QuobyteHD',id=d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390433ed729c4a6db98af4dbd22eaa6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='2fe90e30d38547678e04cec38cbd5410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f4db80-a332-447b-8b2e-e965de292d5f),volume_type_id=19f4db80-a332-447b-8b2e-e965de292d5f)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d6a07-7712-4396-a3f1-8475e8e70b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d6a07-7712-4396-a3f1-8475e8e70b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043d322e-da22-49b9-af24-a7cb9599722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043d322e-da22-49b9-af24-a7cb9599722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd', 'volume_name': 'volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d39f92-954d-4184-a1a3-a851983df7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d39f92-954d-4184-a1a3-a851983df7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e831ed9-ced5-4195-a627-3bea76f566fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Volume d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd', 'volume_size': 1} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1b2e4f0-fcdf-407a-be34-05390a14c4f7,created_at=2026-09-28T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353093127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b2e4f0-fcdf-407a-be34-05390a14c4f7,host='devstack@QuobyteHD#QuobyteHD',id=d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390433ed729c4a6db98af4dbd22eaa6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='2fe90e30d38547678e04cec38cbd5410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f4db80-a332-447b-8b2e-e965de292d5f),volume_type_id=19f4db80-a332-447b-8b2e-e965de292d5f)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Creating volume d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:18:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd 1073741824 Sep 28 18:18:47 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:47 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd 1073741824" returned: 0 in 0.635s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:18:47 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e831ed9-ced5-4195-a627-3bea76f566fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff2dfc8-ad9f-432d-8aa1-cbe2258cf59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Volume volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd (d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd): created successfully Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff2dfc8-ad9f-432d-8aa1-cbe2258cf59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Flow 'volume_create_manager' (5fa326b0-df0a-4354-a4bb-975578afec5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-adfbf4d5-ee3e-4516-842d-e1f32bef16ab tempest-GroupsV314Test-92537420 None] Created volume successfully. Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (231f8284-b383-4e87-9247-c1c031d10da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a7ef0-6acc-408f-9e46-3d325798739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a7ef0-6acc-408f-9e46-3d325798739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1286054520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c6adb8-bc37-47ed-a567-fb54bd68c8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:49Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5aaf6-67ce-4b1d-ba2d-5d399b14d8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5aaf6-67ce-4b1d-ba2d-5d399b14d8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f04dd9a-2e1e-4c91-b823-503a0386e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f04dd9a-2e1e-4c91-b823-503a0386e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c6adb8-bc37-47ed-a567-fb54bd68c8cc', 'volume_name': 'volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f096a4e-d82d-4ac2-a22a-ecda91de8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f096a4e-d82d-4ac2-a22a-ecda91de8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b302b63-1d5d-4f7d-96fc-36fc3526d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Volume 15c6adb8-bc37-47ed-a567-fb54bd68c8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc', 'volume_size': 1} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1286054520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c6adb8-bc37-47ed-a567-fb54bd68c8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:49Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Creating volume 15c6adb8-bc37-47ed-a567-fb54bd68c8cc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:49 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:18:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc 1073741824 Sep 28 18:18:49 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:50 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc 1073741824" returned: 0 in 0.547s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc Sep 28 18:18:50 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.503s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:50 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Cloning volume d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd to volume acb78f34-8037-49f8-85d1-e4245dfc9844 Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b302b63-1d5d-4f7d-96fc-36fc3526d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfac613a-a344-4c2e-9775-f00869ca3b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Volume volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc (15c6adb8-bc37-47ed-a567-fb54bd68c8cc): created successfully Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfac613a-a344-4c2e-9775-f00869ca3b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (231f8284-b383-4e87-9247-c1c031d10da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Creating offline snapshot 65916450-75d9-4790-a580-e8dad738cda8 of volume d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4dda9c66-ef41-4f79-9c30-07fd153c129f tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aa2c90-c0f8-4cfc-9801-1243f99d7c10]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:18:50 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.419s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 1G Sep 28 18:18:51 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 1G" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:18:51 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-15c6adb8-bc37-47ed-a567-fb54bd68c8cc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "cinder-15c6adb8-bc37-47ed-a567-fb54bd68c8cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-quobyte-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[668975c2-ff37-478c-9ac7-87aebd3ade4b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.439s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:18:51 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc Sep 28 18:18:52 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info Sep 28 18:18:52 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc Sep 28 18:18:52 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info Sep 28 18:18:52 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" returned: 0 in 0.358s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-15c6adb8-bc37-47ed-a567-fb54bd68c8cc" released by "delete_volume" :: held 0.863s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Created reservations ['526d0997-d097-498d-bc12-1c0972ce7d4a', '83481310-a42c-4efe-a9a1-96a6b074f96a', '0c0eae53-8654-4017-965a-f388e0ce2885', '41ed0719-1f08-4639-9aca-3d620091222d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:18:53 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:53 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.info" returned: 0 in 0.496s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Acquiring lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] snapshot: 65916450-75d9-4790-a580-e8dad738cda8, volume: acb78f34-8037-49f8-85d1-e4245dfc9844, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc49e3-35e7-4ea7-a171-5ddc3f80670d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.450s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Deleted volume successfully. Sep 28 18:18:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1fbd659d-259b-4bdf-9a0a-c8892a3a45ee tempest-VolumesActionsTest-100115430 None] Lock "cinder-15c6adb8-bc37-47ed-a567-fb54bd68c8cc-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:53 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:18:53 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (89692f33-6608-44e9-a600-354163259e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa455c6b-8969-4da3-934d-bd2a89204a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa455c6b-8969-4da3-934d-bd2a89204a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-349476916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61629af-f848-4f22-a6d3-536fe470d204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:54Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7673e-d7dd-42ed-85ab-057b9f73f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7673e-d7dd-42ed-85ab-057b9f73f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:54 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc1063a-1f37-47ca-9301-9503f16996af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc1063a-1f37-47ca-9301-9503f16996af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61629af-f848-4f22-a6d3-536fe470d204', 'volume_name': 'volume-f61629af-f848-4f22-a6d3-536fe470d204', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961b9a2b-e2b7-458e-99f2-b9385baf8f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961b9a2b-e2b7-458e-99f2-b9385baf8f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f659d4-047a-4ec4-b560-3b97dadcc1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Volume f61629af-f848-4f22-a6d3-536fe470d204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61629af-f848-4f22-a6d3-536fe470d204', 'volume_size': 1} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.774s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f3016-b3d6-441d-ab4d-c7940acdac77]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:54 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:18:54 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:54 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.413s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:18:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:54 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 Sep 28 18:18:54 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:00 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:00 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:00 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.581s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 28 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:19:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:19:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-9d360b2d-b552-4ee1-9ef5-b538c8b63450 req-9f200338-1093-412b-826c-e4b75711d0ca tempest-AttachVolumeTestJSON-407998149 None] Terminate volume connection completed successfully. Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9d360b2d-b552-4ee1-9ef5-b538c8b63450 req-9f200338-1093-412b-826c-e4b75711d0ca tempest-AttachVolumeTestJSON-407998149 None] Deleting attachment 950790b0-75c2-4208-ba37-0cb6eb05ee51. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:19:01 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844" returned: 0 in 6.963s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:19:01 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Converted 1024.00 MB image at 147.04 MB/s Sep 28 18:19:01 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:01 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 Sep 28 18:19:01 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:01 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" released by "_copy_volume_from_snapshot" :: held 8.577s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Acquiring lock "cinder-quobyte-65916450-75d9-4790-a580-e8dad738cda8" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-65916450-75d9-4790-a580-e8dad738cda8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Deleting offline snapshot 65916450-75d9-4790-a580-e8dad738cda8 of volume d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] snapshot_file for this snap is: volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3f3e4-822f-458f-be26-8d069f096175]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:02 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:19:02 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:02 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.464s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:19:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a0589-4217-48c0-b94e-86220a1ac3d5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:02 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:19:02 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:03 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.583s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:03 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:19:03 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:03 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:03 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8 Sep 28 18:19:03 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:03 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd.65916450-75d9-4790-a580-e8dad738cda8" returned: 0 in 0.327s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-65916450-75d9-4790-a580-e8dad738cda8" released by "_delete_snapshot" :: held 1.940s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.320s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.710s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-349476916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61629af-f848-4f22-a6d3-536fe470d204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:54Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Creating volume f61629af-f848-4f22-a6d3-536fe470d204 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:03 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 1073741824 Sep 28 18:19:03 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-88008332-3ec5-49a3-875b-a265bfd141ae tempest-GroupsV314Test-92537420 None] Create group from source-group-f1b2e4f0-fcdf-407a-be34-05390a14c4f7 completed successfully. Sep 28 18:19:04 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 1073741824" returned: 0 in 0.551s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:04 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 Sep 28 18:19:04 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:04 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f659d4-047a-4ec4-b560-3b97dadcc1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61629af-f848-4f22-a6d3-536fe470d204', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddc2fd6-5793-423b-92b7-a69ca25722a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Volume volume-f61629af-f848-4f22-a6d3-536fe470d204 (f61629af-f848-4f22-a6d3-536fe470d204): created successfully Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddc2fd6-5793-423b-92b7-a69ca25722a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (89692f33-6608-44e9-a600-354163259e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9584cdd9-60e2-48d6-83bd-e69ac2509aae tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Acquiring lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aab584-c8e1-42ff-bf00-4dd85be4ee41]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:05 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 Sep 28 18:19:05 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:06 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844" returned: 0 in 0.732s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844 Sep 28 18:19:06 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-f61629af-f848-4f22-a6d3-536fe470d204-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "cinder-f61629af-f848-4f22-a6d3-536fe470d204-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-quobyte-f61629af-f848-4f22-a6d3-536fe470d204" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-f61629af-f848-4f22-a6d3-536fe470d204" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb2b4a-5858-4a4b-8cf0-bb67ad7f882c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 Sep 28 18:19:06 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-acb78f34-8037-49f8-85d1-e4245dfc9844" returned: 0 in 0.864s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-acb78f34-8037-49f8-85d1-e4245dfc9844" released by "delete_volume" :: held 1.680s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Created reservations ['68ed3cdd-5334-4c46-8fce-8a0b8b6bdbf0'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:07 devstack cinder-volume[86560]: WARNING cinder.quota [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-242494061 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-242494061, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:07 devstack cinder-volume[86560]: WARNING cinder.quota [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-242494061 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-242494061, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Created reservations ['51b455f8-d643-45e0-9139-00bc664f1b0c', '0c2c4185-2ad4-43df-a41d-9b167b4d4c9d', 'ee8b1511-6741-455a-b9f7-356d78523901', '4668dbe8-57bc-473c-917c-0472f46ce749'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:07 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204" returned: 0 in 0.854s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:07 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204 Sep 28 18:19:07 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:07 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:07 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:08 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.512s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:08 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f61629af-f848-4f22-a6d3-536fe470d204" returned: 0 in 0.679s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-890f4030-1dbc-4c57-8d75-3a27a9323210 tempest-GroupsV314Test-92537420 None] Delete group completed successfully. Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-f61629af-f848-4f22-a6d3-536fe470d204" released by "delete_volume" :: held 1.684s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Created reservations ['daaee50c-d206-4364-842a-e37bb305402c', '29fe7c7a-d13a-499a-aaca-5f625ecfe435', '4b4d1c79-4890-4ead-8133-edaccb11dfd8', '1089a6ed-c8d0-44af-b551-ca5f4bc07474'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:08 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:08 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Acquiring lock "cinder-quobyte-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" acquired by "delete_volume" :: waited 0.053s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:09 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.550s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f370633-8ac9-421a-bac3-aabdefd80208]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Deleted volume successfully. Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f47ec30d-f02d-489c-848a-d6b47a4b681b tempest-VolumesActionsTest-100115430 None] Lock "cinder-f61629af-f848-4f22-a6d3-536fe470d204-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:09 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:19:09 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:09 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.702s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd Sep 28 18:19:09 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:10 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (ea61d2c9-956f-47e6-a249-e728fd542c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0774cb-fd40-46ca-a8d5-3fc79e3bf102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" returned: 0 in 0.473s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0774cb-fd40-46ca-a8d5-3fc79e3bf102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989992333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddc24b6-1afa-42ba-9395-a3bcf04e26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:10Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af2f4a9-b59a-4761-b9fd-fcf8ffb007c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af2f4a9-b59a-4761-b9fd-fcf8ffb007c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27b1a0e-d8e2-4f4c-9caa-b23752d6eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27b1a0e-d8e2-4f4c-9caa-b23752d6eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddc24b6-1afa-42ba-9395-a3bcf04e26f2', 'volume_name': 'volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228fc9e5-1c0c-46a7-a5d2-e7b2ef3b620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228fc9e5-1c0c-46a7-a5d2-e7b2ef3b620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734f2edb-aa38-4646-a34c-d20aae7485d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Volume 5ddc24b6-1afa-42ba-9395-a3bcf04e26f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2', 'volume_size': 1} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989992333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddc24b6-1afa-42ba-9395-a3bcf04e26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:10Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Creating volume 5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:10 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Lock "cinder-quobyte-d9e3b744-2c0b-4d4a-97a4-c3b7a3db1ccd" released by "delete_volume" :: held 1.441s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:10 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 1073741824 Sep 28 18:19:10 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Created reservations ['fe746b96-b74f-4f8e-a68c-7ec31e588a72'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Created reservations ['f2bd8846-ac82-4ace-9246-c869f633148c', 'c06de7fe-644f-41bc-96b5-1f158066dd24', '9686fd0c-0c22-425c-8875-d704958f4932', 'e4df883f-57cd-4c26-be98-5d0c096f264f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:11 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:11 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 1073741824" returned: 0 in 0.950s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:11 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 Sep 28 18:19:11 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.598s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2ea61060-a539-46a8-8b0c-10d091376b73 tempest-GroupsV314Test-92537420 None] Delete group completed successfully. Sep 28 18:19:11 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" returned: 0 in 0.478s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734f2edb-aa38-4646-a34c-d20aae7485d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3f49cd-9998-41fc-94a7-7a204c93d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:12 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Volume volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 (5ddc24b6-1afa-42ba-9395-a3bcf04e26f2): created successfully Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3f49cd-9998-41fc-94a7-7a204c93d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (ea61d2c9-956f-47e6-a249-e728fd542c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9533b230-bfe0-484b-b802-f64273e587fc tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "cinder-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-quobyte-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b75f6-5552-4f11-9a4d-1d2701cf3271]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 Sep 28 18:19:13 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Acquiring lock "cinder-068cce68-09a5-42b0-9331-c8c11b28939e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "cinder-068cce68-09a5-42b0-9331-c8c11b28939e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Acquiring lock "cinder-quobyte-068cce68-09a5-42b0-9331-c8c11b28939e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "cinder-quobyte-068cce68-09a5-42b0-9331-c8c11b28939e" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" returned: 0 in 0.713s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56812c2d-6265-47a7-ad7d-f550885af55a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2 Sep 28 18:19:13 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:13 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e Sep 28 18:19:13 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" returned: 0 in 0.422s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2" released by "delete_volume" :: held 1.212s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Created reservations ['90a99d23-8b09-4c9c-bc40-217bca6ec403', '67e8d51e-e4c7-4e55-8ff8-7c2ce6d75f2a', '4e066666-6654-4738-8618-b49b18649290', '58d74bf8-c909-4722-9e19-3cac4be5a140'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:14 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e" returned: 0 in 0.571s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e Sep 28 18:19:14 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:14 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-068cce68-09a5-42b0-9331-c8c11b28939e" returned: 0 in 0.496s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.421s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "cinder-quobyte-068cce68-09a5-42b0-9331-c8c11b28939e" released by "delete_volume" :: held 1.151s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Deleted volume successfully. Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0a791604-4abf-4761-bd21-30308c2b78a7 tempest-VolumesActionsTest-100115430 None] Lock "cinder-5ddc24b6-1afa-42ba-9395-a3bcf04e26f2-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Created reservations ['f52f4b04-3eb6-4b75-8a70-6638ecb8a896', '062b779f-5666-417a-b948-c80ca9450bbd', '468219f7-c2ca-451d-a8b3-94a6e6a94a9e', '2e85521e-b284-4771-abde-4ff6ae6551ba'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:15 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.450s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Deleted volume successfully. Sep 28 18:19:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-885df83c-c552-4591-9976-6add7958c3d1 tempest-AttachVolumeShelveTestJSON-853469424 None] Lock "cinder-068cce68-09a5-42b0-9331-c8c11b28939e-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (07d643c2-24d8-4bed-b353-cf1a35683afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ff7c9c-ce88-4384-afd6-0288935efbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ff7c9c-ce88-4384-afd6-0288935efbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1466342653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cdc3fc-321d-483a-9641-9e4eab3711f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:16Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6fbcda-e967-488e-a5d0-3d7e358588d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6fbcda-e967-488e-a5d0-3d7e358588d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cc9f96-f538-41d6-af43-9ff6818e2ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cc9f96-f538-41d6-af43-9ff6818e2ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cdc3fc-321d-483a-9641-9e4eab3711f8', 'volume_name': 'volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbff534-4707-4fbf-973e-f4644d92878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbff534-4707-4fbf-973e-f4644d92878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ec28aa-8946-414d-8ef5-b5c5ff9ed4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Volume a9cdc3fc-321d-483a-9641-9e4eab3711f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8', 'volume_size': 1} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1466342653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cdc3fc-321d-483a-9641-9e4eab3711f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:16Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Creating volume a9cdc3fc-321d-483a-9641-9e4eab3711f8 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:16 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 1073741824 Sep 28 18:19:16 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:16 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 1073741824" returned: 0 in 0.630s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 Sep 28 18:19:16 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:17 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8" returned: 0 in 0.448s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ec28aa-8946-414d-8ef5-b5c5ff9ed4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a97d160-10a8-4825-9a30-d8d89a53009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Volume volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 (a9cdc3fc-321d-483a-9641-9e4eab3711f8): created successfully Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a97d160-10a8-4825-9a30-d8d89a53009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (07d643c2-24d8-4bed-b353-cf1a35683afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0ea8d172-b080-44d3-9c13-7d680337fe58 tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-a9cdc3fc-321d-483a-9641-9e4eab3711f8-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "cinder-a9cdc3fc-321d-483a-9641-9e4eab3711f8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Acquiring lock "cinder-quobyte-a9cdc3fc-321d-483a-9641-9e4eab3711f8" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-a9cdc3fc-321d-483a-9641-9e4eab3711f8" acquired by "delete_volume" :: waited 0.050s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761d4dc-37d0-4a41-8e80-a5b276caba39]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:19 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 Sep 28 18:19:19 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:19 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8" returned: 0 in 0.625s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:19 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8 Sep 28 18:19:19 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:19 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9cdc3fc-321d-483a-9641-9e4eab3711f8" returned: 0 in 0.342s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "cinder-quobyte-a9cdc3fc-321d-483a-9641-9e4eab3711f8" released by "delete_volume" :: held 1.066s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:19 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Created reservations ['c31d0038-4e85-4be9-9a35-b51981ead550', 'ebdb1fbb-8420-487f-805f-aab2aedc8895', '47f8fdda-eab4-4626-a459-fe9e49ec0230', '0bcb6ec0-0b49-4bd9-bee7-22bcccfcfe67'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:20 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:20 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:20 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.567s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:20 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Deleted volume successfully. Sep 28 18:19:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cca27a44-74e6-4510-80de-33a9487211d4 tempest-VolumesActionsTest-100115430 None] Lock "cinder-a9cdc3fc-321d-483a-9641-9e4eab3711f8-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (ef404b4e-5ab7-4a83-97e0-3717f3511f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79799ea4-1378-48a0-9a8e-07feb17a0a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79799ea4-1378-48a0-9a8e-07feb17a0a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-617288011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b70036-c099-453e-8a1d-feda7203722a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:22Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d5fc37-698d-460a-86b2-17bcea336d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d5fc37-698d-460a-86b2-17bcea336d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3859f4-b40c-4fe9-a359-0d2f920714a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3859f4-b40c-4fe9-a359-0d2f920714a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b70036-c099-453e-8a1d-feda7203722a', 'volume_name': 'volume-d1b70036-c099-453e-8a1d-feda7203722a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0174766a-354a-4188-b6f6-0fbea9ea34e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0174766a-354a-4188-b6f6-0fbea9ea34e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052b287d-4d61-435f-bd90-19af1e4c20d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Volume d1b70036-c099-453e-8a1d-feda7203722a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b70036-c099-453e-8a1d-feda7203722a', 'volume_size': 1} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-617288011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b70036-c099-453e-8a1d-feda7203722a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e08a777e5845268813f2532cc102e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:22Z,use_quota=True,user_id='a149c308bbba402e9e6b5699e38098e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Creating volume d1b70036-c099-453e-8a1d-feda7203722a {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:22 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:22 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a 1073741824 Sep 28 18:19:22 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:23 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a 1073741824" returned: 0 in 0.991s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:23 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a Sep 28 18:19:23 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:24 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a" returned: 0 in 0.350s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052b287d-4d61-435f-bd90-19af1e4c20d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b70036-c099-453e-8a1d-feda7203722a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5cb1ea-fa04-4b9f-a0f2-1b8e63ee7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Volume volume-d1b70036-c099-453e-8a1d-feda7203722a (d1b70036-c099-453e-8a1d-feda7203722a): created successfully Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5cb1ea-fa04-4b9f-a0f2-1b8e63ee7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Flow 'volume_create_manager' (ef404b4e-5ab7-4a83-97e0-3717f3511f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-13878f33-d631-42e6-ae5e-8180aa6cf156 tempest-VolumesActionsTest-682578736 None] Created volume successfully. Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-d1b70036-c099-453e-8a1d-feda7203722a-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "cinder-d1b70036-c099-453e-8a1d-feda7203722a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Acquiring lock "cinder-quobyte-d1b70036-c099-453e-8a1d-feda7203722a" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "cinder-quobyte-d1b70036-c099-453e-8a1d-feda7203722a" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[52579b76-9950-4dc7-a6c4-8edb8d9e7b24]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:25 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a Sep 28 18:19:25 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:26 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a" returned: 0 in 0.485s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:26 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a Sep 28 18:19:26 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:26 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1b70036-c099-453e-8a1d-feda7203722a" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "cinder-quobyte-d1b70036-c099-453e-8a1d-feda7203722a" released by "delete_volume" :: held 0.855s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Created reservations ['cbae5683-0593-4242-9fbf-531f38b4624f', 'f360066c-553a-4e56-bcc9-815a0815cefb', '024e38ed-1531-4bbc-a981-245e0986fd04', '8e9fd904-715e-4eda-ab02-624a6682dc01'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:26 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:26 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:27 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:27 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Deleted volume successfully. Sep 28 18:19:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f31cbe39-639a-417d-a2eb-747efbf5b6af tempest-VolumesActionsTest-682578736 None] Lock "cinder-d1b70036-c099-453e-8a1d-feda7203722a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=91,cinder:UPDATE=109,cinder:DELETE=9,cinder:INSERT=24 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Flow 'volume_create_manager' (e33d84e9-9d40-463f-b4c9-9925bc4defa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f277dcc-ea99-47da-bc21-993809fed33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f277dcc-ea99-47da-bc21-993809fed33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532036280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80de5183-d460-4396-9d95-14d6f59d9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f572528a604c90a7207f08d5fca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:34Z,use_quota=True,user_id='8964a36d1b934d89ae67bf9622b1f1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6af56c9c-35e6-4fd4-9a11-373357117bd0),volume_type_id=6af56c9c-35e6-4fd4-9a11-373357117bd0)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf04c48-24a8-41da-9901-fa628bf66430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf04c48-24a8-41da-9901-fa628bf66430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716da02e-5b87-4728-bd50-bf005e3d3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716da02e-5b87-4728-bd50-bf005e3d3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80de5183-d460-4396-9d95-14d6f59d9957', 'volume_name': 'volume-80de5183-d460-4396-9d95-14d6f59d9957', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782ce882-6c95-4aad-a66c-a3a117c7fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782ce882-6c95-4aad-a66c-a3a117c7fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de237d6a-5359-4894-b38d-6c51ccbde473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Volume 80de5183-d460-4396-9d95-14d6f59d9957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80de5183-d460-4396-9d95-14d6f59d9957', 'volume_size': 1} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532036280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80de5183-d460-4396-9d95-14d6f59d9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f572528a604c90a7207f08d5fca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:34Z,use_quota=True,user_id='8964a36d1b934d89ae67bf9622b1f1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6af56c9c-35e6-4fd4-9a11-373357117bd0),volume_type_id=6af56c9c-35e6-4fd4-9a11-373357117bd0)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Creating volume 80de5183-d460-4396-9d95-14d6f59d9957 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:33 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 1073741824 Sep 28 18:19:33 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 1073741824" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 Sep 28 18:19:34 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de237d6a-5359-4894-b38d-6c51ccbde473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80de5183-d460-4396-9d95-14d6f59d9957', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc8de8-755f-45b0-a454-7cbbc81e11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:34 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Volume volume-80de5183-d460-4396-9d95-14d6f59d9957 (80de5183-d460-4396-9d95-14d6f59d9957): created successfully Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc8de8-755f-45b0-a454-7cbbc81e11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Flow 'volume_create_manager' (e33d84e9-9d40-463f-b4c9-9925bc4defa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:34 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ea38091b-2971-4918-ad74-4d0c48d2ef94 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Created volume successfully. Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f26da41c-4489-4a47-8eec-f641341d0d70 tempest-BackendsCapabilitiesAdminTestsJSON-762620614 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9874877929688, 'free_capacity_gb': 1774.9874877929688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:19:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e3d57a69-8c52-4075-9073-9ef08b8e1cd0 tempest-BackendsCapabilitiesAdminTestsJSON-762620614 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9874877929688, 'free_capacity_gb': 1774.9874877929688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:36 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.269s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cd92c8e6-8b1b-493e-8cb9-63003f0ed193 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Retype volume completed successfully. Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "cinder-80de5183-d460-4396-9d95-14d6f59d9957-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "cinder-80de5183-d460-4396-9d95-14d6f59d9957-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "cinder-quobyte-80de5183-d460-4396-9d95-14d6f59d9957" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "cinder-quobyte-80de5183-d460-4396-9d95-14d6f59d9957" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b1387a-d6cc-4faa-a441-a4c23f8a89b6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:37 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 Sep 28 18:19:37 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957" returned: 0 in 0.501s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957 Sep 28 18:19:38 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-80de5183-d460-4396-9d95-14d6f59d9957" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "cinder-quobyte-80de5183-d460-4396-9d95-14d6f59d9957" released by "delete_volume" :: held 0.950s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=112,cinder:SELECT=88,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:38 devstack cinder-volume[86560]: WARNING cinder.quota [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:38 devstack cinder-volume[86560]: WARNING cinder.quota [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Created reservations ['16bb8180-f31a-4ab3-b19e-2dc8fe27f00c', '7d4445d8-13ae-484a-8e52-eb07c7b8a55a', '1cd4f5f6-51a0-4255-a2a3-56e4eb82ca1d', 'd1bb673b-0cde-499b-8bbb-8e33bb7d50a9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:38 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.370s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Deleted volume successfully. Sep 28 18:19:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b6107698-0b3a-484e-b736-fe1d8dc58e07 tempest-VolumeRetypeWithoutMigrationTest-1704223544 None] Lock "cinder-80de5183-d460-4396-9d95-14d6f59d9957-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9f394b5e-e7aa-4dc2-8f4b-e35646d30eb0 tempest-GroupsTest-851396095 None] Group tempest-Group1-757199930: creating Sep 28 18:19:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9f394b5e-e7aa-4dc2-8f4b-e35646d30eb0 tempest-GroupsTest-851396095 None] Group tempest-Group1-757199930: created successfully Sep 28 18:19:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9f394b5e-e7aa-4dc2-8f4b-e35646d30eb0 tempest-GroupsTest-851396095 None] Create group completed successfully. Sep 28 18:19:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cb4412aa-2098-4a7d-ab95-af05ba6a669a tempest-GroupsTest-851396095 None] Group tempest-Group2-207267188: creating Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Flow 'volume_create_manager' (ab907dc2-f2d5-49af-b306-e82ea415b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cf0d49-a9a8-4896-8dc7-02e7a0153d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cb4412aa-2098-4a7d-ab95-af05ba6a669a tempest-GroupsTest-851396095 None] Group tempest-Group2-207267188: created successfully Sep 28 18:19:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cb4412aa-2098-4a7d-ab95-af05ba6a669a tempest-GroupsTest-851396095 None] Create group completed successfully. Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cf0d49-a9a8-4896-8dc7-02e7a0153d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-42309579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f07fe-6295-454a-a837-11be4a606a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e9f33bc474981b5013fd829f3a0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:46Z,use_quota=True,user_id='9ae9715ebb0c45fbbce7900a65224662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344862d-8be9-4cf4-943b-b8cab78ae5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344862d-8be9-4cf4-943b-b8cab78ae5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b1f87b-bf26-4072-a059-9e549846edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b1f87b-bf26-4072-a059-9e549846edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114f07fe-6295-454a-a837-11be4a606a30', 'volume_name': 'volume-114f07fe-6295-454a-a837-11be4a606a30', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcea9f9-fdc9-4920-983d-de3df61c68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcea9f9-fdc9-4920-983d-de3df61c68f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4997b722-4bc7-423d-9515-b8972a8de9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:45 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Volume 114f07fe-6295-454a-a837-11be4a606a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114f07fe-6295-454a-a837-11be4a606a30', 'volume_size': 1} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-42309579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f07fe-6295-454a-a837-11be4a606a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e9f33bc474981b5013fd829f3a0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:46Z,use_quota=True,user_id='9ae9715ebb0c45fbbce7900a65224662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Creating volume 114f07fe-6295-454a-a837-11be4a606a30 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:45 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 1073741824 Sep 28 18:19:45 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 1073741824" returned: 0 in 0.479s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 Sep 28 18:19:46 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4997b722-4bc7-423d-9515-b8972a8de9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114f07fe-6295-454a-a837-11be4a606a30', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415ffd97-bf37-4af3-8356-5a1272978516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Volume volume-114f07fe-6295-454a-a837-11be4a606a30 (114f07fe-6295-454a-a837-11be4a606a30): created successfully Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415ffd97-bf37-4af3-8356-5a1272978516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Flow 'volume_create_manager' (ab907dc2-f2d5-49af-b306-e82ea415b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-84076f40-524f-40ea-b025-078f0734dca0 tempest-AbsoluteLimitsTests-395784110 None] Created volume successfully. Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (9a88edf2-9dc7-4d26-a4bd-c7b807715e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d7dfcd-3c3b-49e4-b98c-e11c81761a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d7dfcd-3c3b-49e4-b98c-e11c81761a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403346067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ef17f8c-297b-4721-bd0b-b38ad9a6139a,host='devstack@QuobyteHD#QuobyteHD',id=08ba51ab-9145-4bf0-a1f9-789ce648da69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:47Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4d6c0bc-d496-4a10-8908-a891795a9e1c),volume_type_id=b4d6c0bc-d496-4a10-8908-a891795a9e1c)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f7f994-3bc2-4f1a-aa23-40725694493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f7f994-3bc2-4f1a-aa23-40725694493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79535505-cfe9-4876-82b0-f29c6d767440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79535505-cfe9-4876-82b0-f29c6d767440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ba51ab-9145-4bf0-a1f9-789ce648da69', 'volume_name': 'volume-08ba51ab-9145-4bf0-a1f9-789ce648da69', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1188e8b-0564-4bf0-aaa5-cfa67b9b376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1188e8b-0564-4bf0-aaa5-cfa67b9b376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31040a-94b8-434c-a64f-237c3af4e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Volume 08ba51ab-9145-4bf0-a1f9-789ce648da69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ba51ab-9145-4bf0-a1f9-789ce648da69', 'volume_size': 1} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ef17f8c-297b-4721-bd0b-b38ad9a6139a,created_at=2026-09-28T16:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403346067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ef17f8c-297b-4721-bd0b-b38ad9a6139a,host='devstack@QuobyteHD#QuobyteHD',id=08ba51ab-9145-4bf0-a1f9-789ce648da69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:47Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4d6c0bc-d496-4a10-8908-a891795a9e1c),volume_type_id=b4d6c0bc-d496-4a10-8908-a891795a9e1c)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Creating volume 08ba51ab-9145-4bf0-a1f9-789ce648da69 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:47 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 1073741824 Sep 28 18:19:47 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 1073741824" returned: 0 in 0.672s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:48 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 Sep 28 18:19:48 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Acquiring lock "cinder-114f07fe-6295-454a-a837-11be4a606a30-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "cinder-114f07fe-6295-454a-a837-11be4a606a30-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Acquiring lock "cinder-quobyte-114f07fe-6295-454a-a837-11be4a606a30" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "cinder-quobyte-114f07fe-6295-454a-a837-11be4a606a30" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[338bb97b-c25a-4f7f-81a2-1e8f73dd4466]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:48 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69" returned: 0 in 0.649s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:48 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 Sep 28 18:19:48 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31040a-94b8-434c-a64f-237c3af4e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ba51ab-9145-4bf0-a1f9-789ce648da69', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cd4137-85fe-45cc-912e-c946ea40f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Volume volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 (08ba51ab-9145-4bf0-a1f9-789ce648da69): created successfully Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cd4137-85fe-45cc-912e-c946ea40f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (9a88edf2-9dc7-4d26-a4bd-c7b807715e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2f11acc7-8593-4255-a2da-4d971055089d tempest-GroupsTest-851396095 None] Created volume successfully. Sep 28 18:19:49 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30" returned: 0 in 0.541s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30 Sep 28 18:19:49 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-114f07fe-6295-454a-a837-11be4a606a30" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "cinder-quobyte-114f07fe-6295-454a-a837-11be4a606a30" released by "delete_volume" :: held 0.981s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Created reservations ['2c723bdb-61c9-4306-be16-74c4ded8dff8', 'f71f5e5e-e0a4-4214-b51b-d327f7104c82', 'a5d9fcfb-21dd-492c-8fea-d01fe9c044cd', 'ca2e37fe-ddbb-41fb-9e07-466c464db389'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:49 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:50 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Deleted volume successfully. Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f32369cb-4814-412f-921a-b11e5c7c8764 tempest-AbsoluteLimitsTests-395784110 None] Lock "cinder-114f07fe-6295-454a-a837-11be4a606a30-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Acquiring lock "cinder-quobyte-08ba51ab-9145-4bf0-a1f9-789ce648da69" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-08ba51ab-9145-4bf0-a1f9-789ce648da69" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[88417991-8f39-4530-824c-f5f53fc94525]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 Sep 28 18:19:51 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:51 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69" returned: 0 in 0.549s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69 Sep 28 18:19:51 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:51 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08ba51ab-9145-4bf0-a1f9-789ce648da69" returned: 0 in 0.359s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-08ba51ab-9145-4bf0-a1f9-789ce648da69" released by "delete_volume" :: held 0.977s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Created reservations ['0712ecb7-85e4-473d-adb5-574ca7c3e317'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:51 devstack cinder-volume[86560]: WARNING cinder.quota [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-697145418 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-697145418, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:51 devstack cinder-volume[86560]: WARNING cinder.quota [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-697145418 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-697145418, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:51 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Created reservations ['559a7bfa-0ab4-4734-8230-7db227104dba', '98de1662-31fa-4036-ae9f-6423198a311f', '74bd2f41-a7f4-421c-af5b-7e3858bf273d', '27dfdb06-ba4b-450d-a20f-96aa181a66af'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:52 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:52 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:52 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.413s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:52 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:52 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-04ba0f99-a71d-4015-91ca-5f9b3c8196ca tempest-GroupsTest-851396095 None] Delete group completed successfully. Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Created reservations ['bb7cf714-7e0a-4890-a13a-0126d3177005'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:53 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:19:53 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.355s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:53 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f9dd5659-d501-4ead-9536-dd77e6ab6a4a tempest-GroupsTest-851396095 None] Delete group completed successfully. Sep 28 18:19:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cda1387c-95cd-4d6d-8a5e-7449e4d1df80 tempest-GroupsTest-851396095 None] Group tempest-GroupsTest-Group-588888687: creating Sep 28 18:19:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cda1387c-95cd-4d6d-8a5e-7449e4d1df80 tempest-GroupsTest-851396095 None] Group tempest-GroupsTest-Group-588888687: created successfully Sep 28 18:19:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cda1387c-95cd-4d6d-8a5e-7449e4d1df80 tempest-GroupsTest-851396095 None] Create group completed successfully. Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (275d7464-479a-4353-87fa-e619450b7067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b844c-a777-4089-9497-791d28950e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b844c-a777-4089-9497-791d28950e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046650088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5ec2e92-6659-425c-abd3-2109c506b46d,host='devstack@QuobyteHD#QuobyteHD',id=43d25b75-0fcd-463c-acfb-2c91c407972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:57Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a57ecc05-e10e-4125-a2fe-3dfb9b6d2287),volume_type_id=a57ecc05-e10e-4125-a2fe-3dfb9b6d2287)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a514ae12-4fd5-44b8-9a5a-92b3867c8ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a514ae12-4fd5-44b8-9a5a-92b3867c8ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58926650-3a8f-43db-9abb-62d8e81909ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58926650-3a8f-43db-9abb-62d8e81909ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d25b75-0fcd-463c-acfb-2c91c407972a', 'volume_name': 'volume-43d25b75-0fcd-463c-acfb-2c91c407972a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111ec1b-e587-45a7-9596-a2aed4739cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111ec1b-e587-45a7-9596-a2aed4739cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423d3481-a7a3-44c0-8fda-194074029265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Volume 43d25b75-0fcd-463c-acfb-2c91c407972a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d25b75-0fcd-463c-acfb-2c91c407972a', 'volume_size': 1} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5ec2e92-6659-425c-abd3-2109c506b46d,created_at=2026-09-28T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046650088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5ec2e92-6659-425c-abd3-2109c506b46d,host='devstack@QuobyteHD#QuobyteHD',id=43d25b75-0fcd-463c-acfb-2c91c407972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:57Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a57ecc05-e10e-4125-a2fe-3dfb9b6d2287),volume_type_id=a57ecc05-e10e-4125-a2fe-3dfb9b6d2287)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Creating volume 43d25b75-0fcd-463c-acfb-2c91c407972a {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:57 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:19:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a 1073741824 Sep 28 18:19:57 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:58 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a 1073741824" returned: 0 in 0.628s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:58 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a Sep 28 18:19:58 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:58 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a" returned: 0 in 0.521s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423d3481-a7a3-44c0-8fda-194074029265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d25b75-0fcd-463c-acfb-2c91c407972a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf37bad-c914-45c6-958d-dd180892c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:58 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Volume volume-43d25b75-0fcd-463c-acfb-2c91c407972a (43d25b75-0fcd-463c-acfb-2c91c407972a): created successfully Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf37bad-c914-45c6-958d-dd180892c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (275d7464-479a-4353-87fa-e619450b7067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2cd51d87-4264-4de2-bfd3-2f0cd39ce496 tempest-GroupsTest-851396095 None] Created volume successfully. Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:00 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:00 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 28 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:20:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (fd55de68-b78b-4b58-8db5-4452e0733f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88600c9e-9aa8-4d64-9fb8-ea0be178329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88600c9e-9aa8-4d64-9fb8-ea0be178329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198835180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5ec2e92-6659-425c-abd3-2109c506b46d,host='devstack@QuobyteHD#QuobyteHD',id=d05334a9-82e0-45dc-8cbc-5a6a6f064686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:01Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a57ecc05-e10e-4125-a2fe-3dfb9b6d2287),volume_type_id=a57ecc05-e10e-4125-a2fe-3dfb9b6d2287)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e346b1d5-b849-4e80-b251-f8dfaeaf9e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e346b1d5-b849-4e80-b251-f8dfaeaf9e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c61737-cabb-4d09-8507-9dc07fe22e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c61737-cabb-4d09-8507-9dc07fe22e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd05334a9-82e0-45dc-8cbc-5a6a6f064686', 'volume_name': 'volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45434efd-42c1-45e4-b2f7-a98da858d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45434efd-42c1-45e4-b2f7-a98da858d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7025ab8-0288-4fe8-9567-207485d7325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Volume d05334a9-82e0-45dc-8cbc-5a6a6f064686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686', 'volume_size': 1} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5ec2e92-6659-425c-abd3-2109c506b46d,created_at=2026-09-28T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198835180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5ec2e92-6659-425c-abd3-2109c506b46d,host='devstack@QuobyteHD#QuobyteHD',id=d05334a9-82e0-45dc-8cbc-5a6a6f064686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbce47874f47446bb121bdfee8bdc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:01Z,use_quota=True,user_id='e8075c9aa5dd412b9934255bf0e8fdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a57ecc05-e10e-4125-a2fe-3dfb9b6d2287),volume_type_id=a57ecc05-e10e-4125-a2fe-3dfb9b6d2287)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Creating volume d05334a9-82e0-45dc-8cbc-5a6a6f064686 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:01 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:01 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 1073741824 Sep 28 18:20:01 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Flow 'volume_create_manager' (532a1344-491a-4543-b7db-46d652d95276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50de7d2a-3f7e-4fb3-9de7-308235008563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50de7d2a-3f7e-4fb3-9de7-308235008563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-253873070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317740bf-8b37-425a-b7cd-64b25b841ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da746619fe489d8f9eba84e112e29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:02Z,use_quota=True,user_id='3a3fd9cdc04948ecb520c144e4df6ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9e31ac-b6a1-48e8-ba74-cbbc06011444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9e31ac-b6a1-48e8-ba74-cbbc06011444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4081e045-047d-4a42-b9fc-5da205eced09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4081e045-047d-4a42-b9fc-5da205eced09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317740bf-8b37-425a-b7cd-64b25b841ca2', 'volume_name': 'volume-317740bf-8b37-425a-b7cd-64b25b841ca2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db70aea-fef5-4a1f-a5b0-ae2f29550740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db70aea-fef5-4a1f-a5b0-ae2f29550740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993513d3-72f7-42f6-8aea-94eafc96108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Volume 317740bf-8b37-425a-b7cd-64b25b841ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317740bf-8b37-425a-b7cd-64b25b841ca2', 'volume_size': 1} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 1073741824" returned: 0 in 0.686s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 Sep 28 18:20:02 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686" returned: 0 in 0.335s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-253873070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317740bf-8b37-425a-b7cd-64b25b841ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da746619fe489d8f9eba84e112e29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:02Z,use_quota=True,user_id='3a3fd9cdc04948ecb520c144e4df6ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Creating volume 317740bf-8b37-425a-b7cd-64b25b841ca2 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:02 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 1073741824 Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7025ab8-0288-4fe8-9567-207485d7325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:02 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b734699c-5cfe-4ad4-9a88-8c69a07834f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Volume volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 (d05334a9-82e0-45dc-8cbc-5a6a6f064686): created successfully Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b734699c-5cfe-4ad4-9a88-8c69a07834f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Flow 'volume_create_manager' (fd55de68-b78b-4b58-8db5-4452e0733f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-21ff3e8f-9255-4470-8134-1904940e08f2 tempest-GroupsTest-851396095 None] Created volume successfully. Sep 28 18:20:03 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 1073741824" returned: 0 in 0.718s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:03 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 Sep 28 18:20:03 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:03 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2" returned: 0 in 0.412s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993513d3-72f7-42f6-8aea-94eafc96108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317740bf-8b37-425a-b7cd-64b25b841ca2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b335c-9288-457b-9cd9-a1e1bfa7a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Volume volume-317740bf-8b37-425a-b7cd-64b25b841ca2 (317740bf-8b37-425a-b7cd-64b25b841ca2): created successfully Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b335c-9288-457b-9cd9-a1e1bfa7a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Flow 'volume_create_manager' (532a1344-491a-4543-b7db-46d652d95276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c99e4e03-8d3d-435e-b363-5fdf27b9c7ca tempest-VolumesTransfersV357Test-966800148 None] Created volume successfully. Sep 28 18:20:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-04577daf-63a7-486e-a346-630869430b60 tempest-GroupsTest-851396095 None] Update group completed successfully. Sep 28 18:20:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d0a60db8-13e0-4000-ad54-653297736fa8 tempest-VolumesTransfersV357Test-1496155093 None] Transfer volume completed successfully. Sep 28 18:20:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-43918ae7-faec-4103-8631-b06d3d8cbea0 tempest-GroupsTest-851396095 None] Update group completed successfully. Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Flow 'volume_create_manager' (4cd40514-7b13-4a76-9fd9-45bc4440a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b8e923-80d8-4cc4-9589-5534721c5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b8e923-80d8-4cc4-9589-5534721c5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-514383393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bdf1f5-575e-4f66-969e-628c1cfebccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb848052a6564ffe810e1e38d979300b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:07Z,use_quota=True,user_id='dcdd304c62f544dd859d49eca8c006b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996385b-3392-4e96-9657-db48db7cb7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996385b-3392-4e96-9657-db48db7cb7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40856a84-e7e0-4740-a710-8947ba8f3f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "cinder-317740bf-8b37-425a-b7cd-64b25b841ca2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-317740bf-8b37-425a-b7cd-64b25b841ca2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Acquiring lock "cinder-quobyte-43d25b75-0fcd-463c-acfb-2c91c407972a" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-43d25b75-0fcd-463c-acfb-2c91c407972a" acquired by "delete_volume" :: waited 0.062s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "cinder-quobyte-317740bf-8b37-425a-b7cd-64b25b841ca2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b9b8e0-0478-4caa-8572-fc970f9aa94e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-quobyte-317740bf-8b37-425a-b7cd-64b25b841ca2" acquired by "delete_volume" :: waited 0.064s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81fe0d-b075-43fa-9e82-913275e9ea36]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:07 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a Sep 28 18:20:07 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:07 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 Sep 28 18:20:07 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40856a84-e7e0-4740-a710-8947ba8f3f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26bdf1f5-575e-4f66-969e-628c1cfebccc', 'volume_name': 'volume-26bdf1f5-575e-4f66-969e-628c1cfebccc', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90cb8d0-2cae-49d2-99e4-c73a6db755cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90cb8d0-2cae-49d2-99e4-c73a6db755cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3962e7-258d-41c3-ba64-a0c8e8753b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:08 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Volume 26bdf1f5-575e-4f66-969e-628c1cfebccc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26bdf1f5-575e-4f66-969e-628c1cfebccc', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Trying to clone 26bdf1f5-575e-4f66-969e-628c1cfebccc from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:20:08 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a" returned: 0 in 0.861s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:08 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a Sep 28 18:20:08 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:08 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2" returned: 0 in 0.939s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:08 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2 Sep 28 18:20:08 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:08 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:20:08 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796c4c8-b474-4583-beec-95044aee190a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:09 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-43d25b75-0fcd-463c-acfb-2c91c407972a" returned: 0 in 0.556s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:09 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-317740bf-8b37-425a-b7cd-64b25b841ca2" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-43d25b75-0fcd-463c-acfb-2c91c407972a" released by "delete_volume" :: held 1.515s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Acquiring lock "cinder-quobyte-d05334a9-82e0-45dc-8cbc-5a6a6f064686" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-quobyte-317740bf-8b37-425a-b7cd-64b25b841ca2" released by "delete_volume" :: held 1.420s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-d05334a9-82e0-45dc-8cbc-5a6a6f064686" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:09 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD Sep 28 18:20:09 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f48dbf-2e29-45ee-bf14-91e402d4485b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Created reservations ['b75f0b35-eff5-44e8-bc5b-0ec2ba969516', '2d0c75aa-5e2a-4b48-b0a6-809ca2de2a4e', 'facaa124-e2e2-43e2-b34c-64d8466da61c', 'bc781dcf-bc4e-4828-966b-f7ce19319fd5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:09 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 Sep 28 18:20:09 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:09 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:09 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 is fetched for user dcdd304c62f544dd859d49eca8c006b9. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc308edb-bacf-4eb3-8480-e50a1067fbaf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:09 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686" returned: 0 in 0.598s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:09 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.467s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:09 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD Sep 28 18:20:09 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Deleted volume successfully. Sep 28 18:20:09 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686 Sep 28 18:20:09 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2301c5ae-aa48-4160-b4e5-31d825256d6a tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-317740bf-8b37-425a-b7cd-64b25b841ca2-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:10 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-514383393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bdf1f5-575e-4f66-969e-628c1cfebccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb848052a6564ffe810e1e38d979300b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:07Z,use_quota=True,user_id='dcdd304c62f544dd859d49eca8c006b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Creating volume 26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:10 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:10 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1073741824 Sep 28 18:20:10 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:10 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d05334a9-82e0-45dc-8cbc-5a6a6f064686" returned: 0 in 0.573s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "cinder-quobyte-d05334a9-82e0-45dc-8cbc-5a6a6f064686" released by "delete_volume" :: held 1.258s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Created reservations ['fc667ebf-1428-4022-8705-0bfcf35f9223'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:10 devstack cinder-volume[86560]: WARNING cinder.quota [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-617997484 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-617997484, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:10 devstack cinder-volume[86560]: WARNING cinder.quota [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-617997484 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-617997484, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Created reservations ['85de9048-b798-4825-83e0-ca9735153e94', '59daab28-5c07-47b9-8752-5e5bf2e2ceac', '74b7df62-ebb5-4c51-a6c7-98c3b71383e9', 'e5c23fa9-9502-4146-9512-d4b323607e28'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Created reservations ['37a9cdfd-6b77-4410-9ce0-c65197daff55', 'b12e4b50-3c89-468d-920f-47a0b9e658ff', 'ec76c51c-a0ae-4a32-bd4b-3860aad0896c', 'c9f5af23-deeb-4c0e-9f2e-ee3854609968'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:11 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1073741824" returned: 0 in 1.056s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Flow 'volume_create_manager' (4404d1a3-4c5b-4044-8e5d-25f813768202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da56efaf-8c75-4b19-b250-89a851d29b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da56efaf-8c75-4b19-b250-89a851d29b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-32667124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5832dce-c091-4acc-9a94-2719317b3a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da746619fe489d8f9eba84e112e29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:11Z,use_quota=True,user_id='3a3fd9cdc04948ecb520c144e4df6ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cd1617-4078-4265-bd8f-790cf60d49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cd1617-4078-4265-bd8f-790cf60d49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233610c7-ff1f-4615-bacd-1bcf27021396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233610c7-ff1f-4615-bacd-1bcf27021396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5832dce-c091-4acc-9a94-2719317b3a81', 'volume_name': 'volume-c5832dce-c091-4acc-9a94-2719317b3a81', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc94765-dc44-45e3-9656-e4221c14fe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc94765-dc44-45e3-9656-e4221c14fe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853b265b-f835-4c46-bf63-e5cfdbac3a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Volume c5832dce-c091-4acc-9a94-2719317b3a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5832dce-c091-4acc-9a94-2719317b3a81', 'volume_size': 1} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:11 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc Sep 28 18:20:11 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:11 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.385s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-94e5c01f-3132-43c0-af6b-2cc9e4132a38 tempest-GroupsTest-851396095 None] Delete group completed successfully. Sep 28 18:20:11 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-32667124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5832dce-c091-4acc-9a94-2719317b3a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da746619fe489d8f9eba84e112e29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:11Z,use_quota=True,user_id='3a3fd9cdc04948ecb520c144e4df6ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Creating volume c5832dce-c091-4acc-9a94-2719317b3a81 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:11 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Attempting download of 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 26bdf1f5-575e-4f66-969e-628c1cfebccc. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:20:12 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 1073741824 Sep 28 18:20:12 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b361dad8-725d-4ae5-b147-b0c6619436e1]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:12 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy Sep 28 18:20:12 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:12 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy" returned: 0 in 0.611s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:12 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 1073741824" returned: 0 in 0.795s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:12 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 Sep 28 18:20:12 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:12 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy Sep 28 18:20:12 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:13 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy" returned: 1 in 0.567s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_a132ydwy' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b7d5c-93fb-4384-8bab-e72cc7421e82]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:13 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81" returned: 0 in 0.520s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853b265b-f835-4c46-bf63-e5cfdbac3a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5832dce-c091-4acc-9a94-2719317b3a81', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b60899b-c287-41c0-b149-068856680c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:13 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Volume volume-c5832dce-c091-4acc-9a94-2719317b3a81 (c5832dce-c091-4acc-9a94-2719317b3a81): created successfully Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b60899b-c287-41c0-b149-068856680c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Flow 'volume_create_manager' (4404d1a3-4c5b-4044-8e5d-25f813768202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:13 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD Sep 28 18:20:13 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-07142918-7ad7-44e3-9a15-fa5988edc63d tempest-VolumesTransfersV357Test-966800148 None] Created volume successfully. Sep 28 18:20:13 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:20:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:13 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc Sep 28 18:20:13 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "cinder-c5832dce-c091-4acc-9a94-2719317b3a81-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-c5832dce-c091-4acc-9a94-2719317b3a81-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "cinder-quobyte-c5832dce-c091-4acc-9a94-2719317b3a81" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-quobyte-c5832dce-c091-4acc-9a94-2719317b3a81" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a223f5f9-0ce0-4ee1-86bd-869ad821f212]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 Sep 28 18:20:15 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81" returned: 0 in 0.426s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81 Sep 28 18:20:15 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5832dce-c091-4acc-9a94-2719317b3a81" returned: 0 in 0.306s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-quobyte-c5832dce-c091-4acc-9a94-2719317b3a81" released by "delete_volume" :: held 0.804s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Created reservations ['a2992189-9e48-4fef-8a17-a37df50a74e4', 'c8ddd80b-0f57-4a40-a0ad-a92f3baefb84', 'd38b1ba9-0fd6-45ed-9fe0-d76be77ec64f', '4797a3e1-9449-4a0f-a5ab-bf16af38a279'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:16 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc" returned: 0 in 2.628s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_rftw2vfydevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:16 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Converted 112.00 MB image at 42.60 MB/s Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1G Sep 28 18:20:16 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.466s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Deleted volume successfully. Sep 28 18:20:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bbd63fe7-81d0-42a0-a4e3-2bbd99e41345 tempest-VolumesTransfersV357Test-1252790530 None] Lock "cinder-c5832dce-c091-4acc-9a94-2719317b3a81-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:17 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc 1G" returned: 0 in 0.596s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Downloaded image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 26bdf1f5-575e-4f66-969e-628c1cfebccc successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 for user dcdd304c62f544dd859d49eca8c006b9 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Marking volume 26bdf1f5-575e-4f66-969e-628c1cfebccc as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Copying metadata from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 to 26bdf1f5-575e-4f66-969e-628c1cfebccc. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Creating volume glance metadata for volume 26bdf1f5-575e-4f66-969e-628c1cfebccc backed by image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3962e7-258d-41c3-ba64-a0c8e8753b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bdf1f5-575e-4f66-969e-628c1cfebccc', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989584e1-a6bc-421a-8138-2e6f8a2045ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Volume volume-26bdf1f5-575e-4f66-969e-628c1cfebccc (26bdf1f5-575e-4f66-969e-628c1cfebccc): created successfully Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989584e1-a6bc-421a-8138-2e6f8a2045ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Flow 'volume_create_manager' (4cd40514-7b13-4a76-9fd9-45bc4440a806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-36398feb-f1d5-4931-b959-3f85b627d27c tempest-VolumesImageMetadata-401346216 None] Created volume successfully. Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Acquiring lock "cinder-26bdf1f5-575e-4f66-969e-628c1cfebccc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "cinder-26bdf1f5-575e-4f66-969e-628c1cfebccc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Acquiring lock "cinder-quobyte-26bdf1f5-575e-4f66-969e-628c1cfebccc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "cinder-quobyte-26bdf1f5-575e-4f66-969e-628c1cfebccc" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c20c3ab-46b4-40c1-af10-19473aad83c8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc Sep 28 18:20:18 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:19 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc" returned: 0 in 0.614s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc Sep 28 18:20:19 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:19 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-26bdf1f5-575e-4f66-969e-628c1cfebccc" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "cinder-quobyte-26bdf1f5-575e-4f66-969e-628c1cfebccc" released by "delete_volume" :: held 1.114s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Created reservations ['20796413-3d37-429e-97e5-5e9072995255', '0f5ed573-c6b5-484b-b274-cfd6d14e18e4', 'a7b635ce-ad34-42ca-ad32-09008cdf15ff', 'c6f6bfaa-b6a5-4781-96c1-b046a7804fe9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:19 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.340s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:20 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Deleted volume successfully. Sep 28 18:20:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feee20a0-47e6-4bd4-b4db-51e91606e727 tempest-VolumesImageMetadata-401346216 None] Lock "cinder-26bdf1f5-575e-4f66-969e-628c1cfebccc-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-09498c7d-4096-45a0-8a09-15a91e912986 tempest-GroupsV320Test-2071635583 None] Group tempest-GroupsV320Test-Group-732193390: creating Sep 28 18:20:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-09498c7d-4096-45a0-8a09-15a91e912986 tempest-GroupsV320Test-2071635583 None] Group tempest-GroupsV320Test-Group-732193390: created successfully Sep 28 18:20:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-09498c7d-4096-45a0-8a09-15a91e912986 tempest-GroupsV320Test-2071635583 None] Create group completed successfully. Sep 28 18:20:23 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Created reservations ['70066636-bfb6-49e4-b843-076eb6da2e51'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:24 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:24 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.292s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0ab034fa-0e2c-401b-90a0-571146f03d37 tempest-GroupsV320Test-2071635583 None] Delete group completed successfully. Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Flow 'volume_create_manager' (a021cd51-e66c-41d4-945b-41b95bc1f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4c2cc-b389-433e-8019-3297f0c75bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4c2cc-b389-433e-8019-3297f0c75bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1181830993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b65fd9-26b3-4164-bcf5-30c3f68f414e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3ba8d9fd1b4e5f8d9e6122c5f3d877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:26Z,use_quota=True,user_id='e5bb645375a247d8bb3a657fdc8ff0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5eeb39-6eab-4bec-895c-5fc9e548dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5eeb39-6eab-4bec-895c-5fc9e548dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf5509f-d78f-47f5-8ea8-200343d60369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf5509f-d78f-47f5-8ea8-200343d60369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b65fd9-26b3-4164-bcf5-30c3f68f414e', 'volume_name': 'volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e', 'volume_size': 2}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59bcc2f-a9a6-4228-b4d2-5e8744d70f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59bcc2f-a9a6-4228-b4d2-5e8744d70f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39e3c4f-4a1e-4dfc-84c9-6ee96e3e5fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Volume 16b65fd9-26b3-4164-bcf5-30c3f68f414e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e', 'volume_size': 2} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1181830993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b65fd9-26b3-4164-bcf5-30c3f68f414e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3ba8d9fd1b4e5f8d9e6122c5f3d877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:26Z,use_quota=True,user_id='e5bb645375a247d8bb3a657fdc8ff0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Creating volume 16b65fd9-26b3-4164-bcf5-30c3f68f414e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:26 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e 2147483648 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e 2147483648 Sep 28 18:20:26 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e 2147483648" returned: 0 in 0.658s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e Sep 28 18:20:26 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e" returned: 0 in 0.305s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39e3c4f-4a1e-4dfc-84c9-6ee96e3e5fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e', 'volume_size': 2}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9d4e50-d146-4f2c-8eed-eab864e2aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Volume volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e (16b65fd9-26b3-4164-bcf5-30c3f68f414e): created successfully Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9d4e50-d146-4f2c-8eed-eab864e2aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Flow 'volume_create_manager' (a021cd51-e66c-41d4-945b-41b95bc1f952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-69a756b4-2c72-48f2-994e-31f6d3462280 tempest-VolumesCloneNegativeTest-91630816 None] Created volume successfully. Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Acquiring lock "cinder-16b65fd9-26b3-4164-bcf5-30c3f68f414e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "cinder-16b65fd9-26b3-4164-bcf5-30c3f68f414e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Acquiring lock "cinder-quobyte-16b65fd9-26b3-4164-bcf5-30c3f68f414e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "cinder-quobyte-16b65fd9-26b3-4164-bcf5-30c3f68f414e" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0161631f-2fe2-4b66-8af3-9be411d3ad31]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:28 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e Sep 28 18:20:28 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:28 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e" returned: 0 in 0.614s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:28 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e Sep 28 18:20:28 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:29 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-16b65fd9-26b3-4164-bcf5-30c3f68f414e" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "cinder-quobyte-16b65fd9-26b3-4164-bcf5-30c3f68f414e" released by "delete_volume" :: held 1.054s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Created reservations ['9a38eb6d-7ce2-422e-b70c-fd7bee80a548', '1218a2cb-1115-4715-9b11-2246a0ce6530', '61337be6-ab97-4bfa-b3d4-b5947a6112e1', 'cad4ec31-2e26-41eb-b4cd-575d0b279d08'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:29 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:29 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:29 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:29 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Deleted volume successfully. Sep 28 18:20:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-394b1245-e4b9-462a-8678-bb0697b843a9 tempest-VolumesCloneNegativeTest-91630816 None] Lock "cinder-16b65fd9-26b3-4164-bcf5-30c3f68f414e-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=120,cinder:SELECT=111,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Flow 'volume_create_manager' (f3a32b7e-3972-4940-8f38-63bcd0d83c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d4fcc-4b23-451b-9ba5-fe0b08a1f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d4fcc-4b23-451b-9ba5-fe0b08a1f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1426551082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62aac7934e143308c35fd557e0fcbd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='978e9b8de4ab45e3b363e9134215e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c0093-1bcd-4a79-99fc-d16447fd5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c0093-1bcd-4a79-99fc-d16447fd5339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd18052e-428d-4e9c-870f-4aaec2848bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd18052e-428d-4e9c-870f-4aaec2848bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d', 'volume_name': 'volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870eeb69-6467-41bd-8cd2-7299533d245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870eeb69-6467-41bd-8cd2-7299533d245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f9fbab-3a66-465f-b44c-61d11e93a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Volume a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d', 'volume_size': 1} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1426551082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62aac7934e143308c35fd557e0fcbd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='978e9b8de4ab45e3b363e9134215e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Creating volume a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:33 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:33 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d 1073741824 Sep 28 18:20:33 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (85450415-1440-47cc-8601-afa397923c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42e4de6-922b-49a1-8926-c657bfd5af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42e4de6-922b-49a1-8926-c657bfd5af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-92774681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6261dc-66e0-4921-999f-ef1f6172bd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ec929f-fcaf-4053-b1b7-e174b6356f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ec929f-fcaf-4053-b1b7-e174b6356f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c8f87-882b-4292-9c99-ac8e1eba836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c8f87-882b-4292-9c99-ac8e1eba836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b6261dc-66e0-4921-999f-ef1f6172bd00', 'volume_name': 'volume-2b6261dc-66e0-4921-999f-ef1f6172bd00', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3e272-58b8-4e5b-9baa-15c340369dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3e272-58b8-4e5b-9baa-15c340369dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2aa095-5db0-4b86-b02c-d04b06dfe1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Volume 2b6261dc-66e0-4921-999f-ef1f6172bd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b6261dc-66e0-4921-999f-ef1f6172bd00', 'volume_size': 1} Sep 28 18:20:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:34 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d 1073741824" returned: 0 in 0.597s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d Sep 28 18:20:34 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-92774681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6261dc-66e0-4921-999f-ef1f6172bd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Creating volume 2b6261dc-66e0-4921-999f-ef1f6172bd00 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:34 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 1073741824 Sep 28 18:20:34 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f9fbab-3a66-465f-b44c-61d11e93a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9eb511-07da-4691-b07f-8fd3b0675383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:34 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Volume volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d (a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d): created successfully Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9eb511-07da-4691-b07f-8fd3b0675383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Flow 'volume_create_manager' (f3a32b7e-3972-4940-8f38-63bcd0d83c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:34 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d43aeb7a-5676-4bdc-853a-3098584a9847 tempest-VolumesTransfersTest-570682891 None] Created volume successfully. Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Flow 'volume_create_manager' (0cc31ad6-a12e-4dcf-9df8-0080b0b01bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f70ec5-fe1f-44ee-82ec-58579856fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f70ec5-fe1f-44ee-82ec-58579856fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1699981535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4ee7342d9c4b12b348a67ed6c4227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:35Z,use_quota=True,user_id='43f8deb8960d4ec695d254ffd482db9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59750ecd-46a7-450c-94e0-52d6c44b5133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59750ecd-46a7-450c-94e0-52d6c44b5133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952801cf-e0ac-49cf-9422-a651e0abfa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952801cf-e0ac-49cf-9422-a651e0abfa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38', 'volume_name': 'volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9b63dd-7ed4-4a2b-8511-c1f78000eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9b63dd-7ed4-4a2b-8511-c1f78000eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefaf7d-0951-44bf-ae07-0902c51aeb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume 87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38', 'volume_size': 1} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:35 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 1073741824" returned: 0 in 0.651s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 Sep 28 18:20:35 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1699981535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4ee7342d9c4b12b348a67ed6c4227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:35Z,use_quota=True,user_id='43f8deb8960d4ec695d254ffd482db9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Creating volume 87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:35 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2aa095-5db0-4b86-b02c-d04b06dfe1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6261dc-66e0-4921-999f-ef1f6172bd00', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 1073741824 Sep 28 18:20:35 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b29331-73ba-4174-8dce-2911c045167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:35 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Volume volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 (2b6261dc-66e0-4921-999f-ef1f6172bd00): created successfully Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b29331-73ba-4174-8dce-2911c045167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (85450415-1440-47cc-8601-afa397923c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-24660faf-e4ba-432a-8cca-6dc76426c557 tempest-AttachVolumeTestJSON-407998149 None] Created volume successfully. Sep 28 18:20:36 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 1073741824" returned: 0 in 0.734s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8af5dcd8-cc6e-4b0d-b0f5-07e611578c38 tempest-VolumesTransfersTest-1630741616 None] Transfer volume completed successfully. Sep 28 18:20:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:36 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 Sep 28 18:20:36 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefaf7d-0951-44bf-ae07-0902c51aeb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f69ad4e-b3ec-4bdb-b3df-1ed8b7e740e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 (87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38): created successfully Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f69ad4e-b3ec-4bdb-b3df-1ed8b7e740e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Flow 'volume_create_manager' (0cc31ad6-a12e-4dcf-9df8-0080b0b01bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-08eb350b-f2dc-4eb3-add5-f3b31214c6bd tempest-VolumeQuotasAdminTestJSON-1401914757 None] Created volume successfully. Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Acquiring lock "cinder-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "cinder-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Acquiring lock "cinder-quobyte-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "cinder-quobyte-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "cinder-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d243f44-437c-41d6-9db7-7343e4701434]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "cinder-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "cinder-quobyte-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "cinder-quobyte-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf60a0a-20f7-486c-9ba0-6ce81f6df84b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d Sep 28 18:20:37 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 Sep 28 18:20:37 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bcf24475-ac7d-4fa5-a301-3fd42bf38647 req-77689818-a496-4d7e-8323-0cb05e5049f1 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bcf24475-ac7d-4fa5-a301-3fd42bf38647 req-77689818-a496-4d7e-8323-0cb05e5049f1 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-bcf24475-ac7d-4fa5-a301-3fd42bf38647 req-77689818-a496-4d7e-8323-0cb05e5049f1 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-bcf24475-ac7d-4fa5-a301-3fd42bf38647 req-77689818-a496-4d7e-8323-0cb05e5049f1 tempest-AttachVolumeTestJSON-407998149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-2b6261dc-66e0-4921-999f-ef1f6172bd00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '670e4eac-a2fb-40a9-9de5-148e5b698ed8', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:20:38 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-bcf24475-ac7d-4fa5-a301-3fd42bf38647 req-77689818-a496-4d7e-8323-0cb05e5049f1 tempest-AttachVolumeTestJSON-407998149 None] attachment_update completed successfully. Sep 28 18:20:38 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" returned: 0 in 0.445s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" returned: 0 in 0.602s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38 Sep 28 18:20:38 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:38 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d Sep 28 18:20:38 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:38 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "cinder-quobyte-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d" released by "delete_volume" :: held 1.095s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:INSERT=30,cinder:UPDATE=129,cinder:SELECT=102,cinder:DELETE=6 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:38 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" returned: 0 in 0.518s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "cinder-quobyte-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38" released by "delete_volume" :: held 1.049s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Created reservations ['cc472b1b-1873-40db-bee8-0b5431a98fc0', 'd51de0ad-4950-456b-90ec-0e9922cb4611', '0f35d861-60d8-4081-913f-4f81a18cf696', '6060c4d2-3fa6-4d95-890a-e7b77cb3b80e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Created reservations ['6a636e67-9a49-4bbd-9f65-a1c9ef8f600b', 'e724da76-8260-40f1-b180-73c36c156780', '6c0e4e0d-8b51-4ff9-9819-fd4b350e39d8', '957921b5-26cc-4d63-8261-4c5937f00fb8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:38 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:39 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:39 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:39 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.403s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Deleted volume successfully. Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d390cb8-dc72-480c-bffe-3c23c912fefb tempest-VolumesTransfersTest-954312642 None] Lock "cinder-a0e99aa1-c3c1-47c3-bedf-1ec5631a4f5d-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:39 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Deleted volume successfully. Sep 28 18:20:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e23360b3-058d-4740-b479-353e0949ec6d tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "cinder-87a2d9de-d4ce-4ddf-b2db-d6d7ea1d5b38-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Flow 'volume_create_manager' (d14a7df6-9a80-47de-83a0-ad7228976111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bbee34-41f9-4d44-b8b5-86e7567dbce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bbee34-41f9-4d44-b8b5-86e7567dbce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011583294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe2247-bf50-4edb-ab02-b97a044e8acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62aac7934e143308c35fd557e0fcbd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='978e9b8de4ab45e3b363e9134215e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c02de-9008-4315-8eef-b206a47ba9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c02de-9008-4315-8eef-b206a47ba9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea41a515-5a72-4bc3-9ecf-44fdeef02254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea41a515-5a72-4bc3-9ecf-44fdeef02254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebe2247-bf50-4edb-ab02-b97a044e8acc', 'volume_name': 'volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f957d8-72fa-4b34-b5b2-885bb58d7446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f957d8-72fa-4b34-b5b2-885bb58d7446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806f47e4-ecf8-4f2c-b25b-baa2ffeea951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Volume 5ebe2247-bf50-4edb-ab02-b97a044e8acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc', 'volume_size': 1} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011583294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe2247-bf50-4edb-ab02-b97a044e8acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62aac7934e143308c35fd557e0fcbd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='978e9b8de4ab45e3b363e9134215e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Creating volume 5ebe2247-bf50-4edb-ab02-b97a044e8acc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:41 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:41 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc 1073741824 Sep 28 18:20:41 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Flow 'volume_create_manager' (f989bc6f-2bae-4106-9bf6-c634d0011a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e57945d-482e-4884-bc47-16d15687977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e57945d-482e-4884-bc47-16d15687977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-338155746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a12622-d916-4ede-8d96-27466b1fa22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4ee7342d9c4b12b348a67ed6c4227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='43f8deb8960d4ec695d254ffd482db9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6960e72b-fabe-4bf2-a762-783e87630906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6960e72b-fabe-4bf2-a762-783e87630906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c50615-103a-4abc-a2be-fe92e1589b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c50615-103a-4abc-a2be-fe92e1589b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a12622-d916-4ede-8d96-27466b1fa22d', 'volume_name': 'volume-02a12622-d916-4ede-8d96-27466b1fa22d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decd3bde-47e2-4526-aa6e-db1da05b097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decd3bde-47e2-4526-aa6e-db1da05b097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce19a656-ff72-4fa0-9e8e-d8314f7e9713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume 02a12622-d916-4ede-8d96-27466b1fa22d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a12622-d916-4ede-8d96-27466b1fa22d', 'volume_size': 1} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (d11d5d90-1aaf-43d2-a9d1-d6e441def704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa9dc08-da1f-4760-befa-ee0f9157f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa9dc08-da1f-4760-befa-ee0f9157f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1974906106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d489fa2c-6c60-415b-944b-842bbe5e79a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede5661b-887c-410b-a30a-50571e5e9f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede5661b-887c-410b-a30a-50571e5e9f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d01162-65b6-4cfe-8234-11b87cab3c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d01162-65b6-4cfe-8234-11b87cab3c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd489fa2c-6c60-415b-944b-842bbe5e79a9', 'volume_name': 'volume-d489fa2c-6c60-415b-944b-842bbe5e79a9', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b81c67-b2f9-4aec-90ac-022e95cfedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b81c67-b2f9-4aec-90ac-022e95cfedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3675032-c7ec-4cb9-ae3a-8372bbfe6449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Volume d489fa2c-6c60-415b-944b-842bbe5e79a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d489fa2c-6c60-415b-944b-842bbe5e79a9', 'volume_size': 1} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc 1073741824" returned: 0 in 0.606s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc Sep 28 18:20:41 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-338155746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a12622-d916-4ede-8d96-27466b1fa22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4ee7342d9c4b12b348a67ed6c4227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='43f8deb8960d4ec695d254ffd482db9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Creating volume 02a12622-d916-4ede-8d96-27466b1fa22d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806f47e4-ecf8-4f2c-b25b-baa2ffeea951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d 1073741824 Sep 28 18:20:42 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679bf08-b9a9-43be-9634-72cd53bd3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Volume volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc (5ebe2247-bf50-4edb-ab02-b97a044e8acc): created successfully Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679bf08-b9a9-43be-9634-72cd53bd3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Flow 'volume_create_manager' (d14a7df6-9a80-47de-83a0-ad7228976111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a6f08ba8-8064-407c-9408-0d76f0cd0239 tempest-VolumesTransfersTest-570682891 None] Created volume successfully. Sep 28 18:20:42 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d 1073741824" returned: 0 in 0.553s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d Sep 28 18:20:42 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Acquiring lock "cinder-5ebe2247-bf50-4edb-ab02-b97a044e8acc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d" returned: 0 in 0.340s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1974906106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d489fa2c-6c60-415b-944b-842bbe5e79a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1c797d10d149bb9dbc048fb03330df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='76cb5b89180e41fa810888bbf224839c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Creating volume d489fa2c-6c60-415b-944b-842bbe5e79a9 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:43 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "cinder-5ebe2247-bf50-4edb-ab02-b97a044e8acc-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:43 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 1073741824 Sep 28 18:20:43 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce19a656-ff72-4fa0-9e8e-d8314f7e9713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a12622-d916-4ede-8d96-27466b1fa22d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943e2ddc-bbd1-4eb3-adc3-bcff95559a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Volume volume-02a12622-d916-4ede-8d96-27466b1fa22d (02a12622-d916-4ede-8d96-27466b1fa22d): created successfully Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943e2ddc-bbd1-4eb3-adc3-bcff95559a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Flow 'volume_create_manager' (f989bc6f-2bae-4106-9bf6-c634d0011a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b83541d4-3f92-42c0-9635-b52ce9cfbc8f tempest-VolumeQuotasAdminTestJSON-1401914757 None] Created volume successfully. Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Acquiring lock "cinder-quobyte-5ebe2247-bf50-4edb-ab02-b97a044e8acc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "cinder-quobyte-5ebe2247-bf50-4edb-ab02-b97a044e8acc" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4ce678-6681-47e9-86a7-14134a0f189b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc Sep 28 18:20:43 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 1073741824" returned: 0 in 0.559s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 Sep 28 18:20:43 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc" returned: 0 in 0.493s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc Sep 28 18:20:43 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9" returned: 0 in 0.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3675032-c7ec-4cb9-ae3a-8372bbfe6449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d489fa2c-6c60-415b-944b-842bbe5e79a9', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70db1921-d4e8-4f64-93d9-292161bdfe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Volume volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 (d489fa2c-6c60-415b-944b-842bbe5e79a9): created successfully Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70db1921-d4e8-4f64-93d9-292161bdfe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Flow 'volume_create_manager' (d11d5d90-1aaf-43d2-a9d1-d6e441def704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b6b82c4a-453c-41f0-9efc-af3374da0b84 tempest-AttachVolumeTestJSON-407998149 None] Created volume successfully. Sep 28 18:20:44 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5ebe2247-bf50-4edb-ab02-b97a044e8acc" returned: 0 in 0.496s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "cinder-quobyte-5ebe2247-bf50-4edb-ab02-b97a044e8acc" released by "delete_volume" :: held 1.063s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Created reservations ['1461fb69-db9f-436a-9d65-260f2af138d1', '065cdb5a-e95d-4d8d-b4f4-0a0a7e20deb3', '1d6b6ca8-d27a-476c-a0bd-f0c34d0579c9', '202a2cec-bad1-4f02-be6e-007423796da8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:44 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.375s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-89f042a7-58d9-404b-b14c-fbf6a56bf3b7 tempest-VolumeQuotasAdminTestJSON-544529287 None] Transfer volume completed successfully. Sep 28 18:20:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Deleted volume successfully. Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5ebf0ecc-2999-4b77-a660-a29e771a1f5f tempest-VolumesTransfersTest-954312642 None] Lock "cinder-5ebe2247-bf50-4edb-ab02-b97a044e8acc-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-0d8a7384-1b85-425d-a486-47adc2e87d95 req-4b986b3f-4b0a-4f4e-ae12-1f2546cb2cf6 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-0d8a7384-1b85-425d-a486-47adc2e87d95 req-4b986b3f-4b0a-4f4e-ae12-1f2546cb2cf6 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-0d8a7384-1b85-425d-a486-47adc2e87d95 req-4b986b3f-4b0a-4f4e-ae12-1f2546cb2cf6 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-0d8a7384-1b85-425d-a486-47adc2e87d95 req-4b986b3f-4b0a-4f4e-ae12-1f2546cb2cf6 tempest-AttachVolumeTestJSON-407998149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-d489fa2c-6c60-415b-944b-842bbe5e79a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08ad9a4d-5d1e-4f07-a572-275eb7539ff8', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:20:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-0d8a7384-1b85-425d-a486-47adc2e87d95 req-4b986b3f-4b0a-4f4e-ae12-1f2546cb2cf6 tempest-AttachVolumeTestJSON-407998149 None] attachment_update completed successfully. Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Acquiring lock "cinder-02a12622-d916-4ede-8d96-27466b1fa22d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "cinder-02a12622-d916-4ede-8d96-27466b1fa22d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Acquiring lock "cinder-quobyte-02a12622-d916-4ede-8d96-27466b1fa22d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "cinder-quobyte-02a12622-d916-4ede-8d96-27466b1fa22d" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3b2b39-11c6-4bff-befe-9516ccc6f9a2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d Sep 28 18:20:45 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d" returned: 0 in 0.595s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d Sep 28 18:20:46 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-02a12622-d916-4ede-8d96-27466b1fa22d" returned: 0 in 0.433s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "cinder-quobyte-02a12622-d916-4ede-8d96-27466b1fa22d" released by "delete_volume" :: held 1.106s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Created reservations ['bea7bc7f-0ec3-4a9d-9057-de5a13a5f02c', 'acdaf8e0-b0e3-4a31-ab01-859d11f88f5c', 'cccb3a75-0460-4ac6-abf3-f856c85d1b4d', '9b4a7654-0b1d-4fbc-8941-feb11effe358'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:47 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:47 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:47 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Deleted volume successfully. Sep 28 18:20:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2fc2de4-2033-45e3-86fc-bc92f0a0ef7f tempest-VolumeQuotasAdminTestJSON-1963029905 None] Lock "cinder-02a12622-d916-4ede-8d96-27466b1fa22d-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-29e2029a-f1fb-4c41-a919-1d170ce31909 req-21c959a1-731a-4faf-a1d6-d84f0914fed5 tempest-AttachVolumeTestJSON-407998149 None] Terminate volume connection completed successfully. Sep 28 18:20:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-29e2029a-f1fb-4c41-a919-1d170ce31909 req-21c959a1-731a-4faf-a1d6-d84f0914fed5 tempest-AttachVolumeTestJSON-407998149 None] Deleting attachment 670e4eac-a2fb-40a9-9de5-148e5b698ed8. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:20:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-d85975ef-c315-407f-b3ac-07f2382eb975 req-62e8c193-0a2b-477b-aff5-d7d274adc71d tempest-AttachVolumeTestJSON-407998149 None] Terminate volume connection completed successfully. Sep 28 18:20:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-d85975ef-c315-407f-b3ac-07f2382eb975 req-62e8c193-0a2b-477b-aff5-d7d274adc71d tempest-AttachVolumeTestJSON-407998149 None] Deleting attachment 08ad9a4d-5d1e-4f07-a572-275eb7539ff8. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (d63c413b-9682-4a02-90f1-5c1820024dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a902618c-c583-4e9f-b782-790905a99d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a902618c-c583-4e9f-b782-790905a99d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570493278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:52Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216aa79b-0b8e-4340-a970-bde9bbb248a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216aa79b-0b8e-4340-a970-bde9bbb248a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2b787f-1cf2-4dc9-abc7-70bf219306ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2b787f-1cf2-4dc9-abc7-70bf219306ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3', 'volume_name': 'volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16cc3f7-c905-4d67-bcdf-ef75458942bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16cc3f7-c905-4d67-bcdf-ef75458942bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa27b1c-3939-4ee8-9809-091a518fdc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:51 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Volume 30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3', 'volume_size': 1} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570493278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:52Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Creating volume 30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:51 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:20:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:51 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 1073741824 Sep 28 18:20:51 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:52 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 1073741824" returned: 0 in 0.807s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:52 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 Sep 28 18:20:52 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:53 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa27b1c-3939-4ee8-9809-091a518fdc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8945a6d8-9bc8-4409-9ec8-0bc4f43c3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Volume volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 (30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3): created successfully Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8945a6d8-9bc8-4409-9ec8-0bc4f43c3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (d63c413b-9682-4a02-90f1-5c1820024dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6067a71c-e15c-442c-b4c1-d911819f3113 tempest-VolumesSnapshotTestJSON-403957920 None] Created volume successfully. Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Creating offline snapshot 4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 of volume 30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef366e4d-cf3a-40f1-87a1-4d5bd06e04df]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:55 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 Sep 28 18:20:55 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:55 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" returned: 0 in 0.647s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:55 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 1G Sep 28 18:20:55 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:56 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 1G" returned: 0 in 0.758s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:56 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 Sep 28 18:20:56 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" returned: 0 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 is being set with open permissions: ugo+rw Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:57 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 Sep 28 18:20:57 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-d489fa2c-6c60-415b-944b-842bbe5e79a9-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-d489fa2c-6c60-415b-944b-842bbe5e79a9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-quobyte-d489fa2c-6c60-415b-944b-842bbe5e79a9" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:57 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Flow 'volume_create_manager' (fa6f4fa9-da5a-4f9f-b606-77cd0dcf0b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c27e76-5007-4177-9026-1a09fa725a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-d489fa2c-6c60-415b-944b-842bbe5e79a9" acquired by "delete_volume" :: waited 0.077s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" returned: 0 in 0.531s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622fc1f-5040-4232-9f32-14db61cf3fd9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c27e76-5007-4177-9026-1a09fa725a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1784249502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8380a31c-8aa7-4921-a184-70b107bcc2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d967648d7e47679dc37de1955cbfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:58Z,use_quota=True,user_id='26f3138989d642a2a0d162dc3442eb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add6467-2b3f-42ae-8d84-294f0a494dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add6467-2b3f-42ae-8d84-294f0a494dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8193dfc3-ce72-43c9-9770-682a4dc8e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:20:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:57 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info Sep 28 18:20:57 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 Sep 28 18:20:57 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:58 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info is being set with open permissions: ugo+rw Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:58 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9" returned: 0 in 0.565s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:58 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info Sep 28 18:20:58 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:58 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9 Sep 28 18:20:58 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:58 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.info" returned: 0 in 0.493s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.542s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:58 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d489fa2c-6c60-415b-944b-842bbe5e79a9" returned: 0 in 0.579s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8193dfc3-ce72-43c9-9770-682a4dc8e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8380a31c-8aa7-4921-a184-70b107bcc2d3', 'volume_name': 'volume-8380a31c-8aa7-4921-a184-70b107bcc2d3', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124b9267-75ab-4fc1-8509-28c4e65c6875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124b9267-75ab-4fc1-8509-28c4e65c6875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7a06f-6729-4953-b8ea-0873d4d9e5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:58 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Volume 8380a31c-8aa7-4921-a184-70b107bcc2d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8380a31c-8aa7-4921-a184-70b107bcc2d3', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Trying to clone 8380a31c-8aa7-4921-a184-70b107bcc2d3 from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:20:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9e19c6d2-28ef-4c3e-beba-a630286ec53c tempest-VolumesSnapshotTestJSON-403957920 None] Create snapshot completed successfully Sep 28 18:20:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-d489fa2c-6c60-415b-944b-842bbe5e79a9" released by "delete_volume" :: held 1.262s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Created reservations ['c1a4aac9-9f50-43f9-a139-a06f713103db', 'c19e38bd-6981-4ddf-86c6-e2d2c676ce5f', 'd454c3b0-35e5-47a7-81d0-3de1038cb3c5', '2219c3cd-f189-4aed-8c38-4ab2674a02e0'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:20:59 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:20:59 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:20:59 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.332s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Deleted volume successfully. Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1c3234b7-acc9-40ea-a8b5-ff37187239e9 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-d489fa2c-6c60-415b-944b-842bbe5e79a9-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434bc7a-e1f3-4672-b21f-36f610df78cb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD Sep 28 18:20:59 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Deleting offline snapshot 4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 of volume 30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] snapshot_file for this snap is: volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-2b6261dc-66e0-4921-999f-ef1f6172bd00-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434d92a-316c-4cec-87f8-826eb838e71f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-2b6261dc-66e0-4921-999f-ef1f6172bd00-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 is fetched for user 26f3138989d642a2a0d162dc3442eb84. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-quobyte-2b6261dc-66e0-4921-999f-ef1f6172bd00" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-2b6261dc-66e0-4921-999f-ef1f6172bd00" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 Sep 28 18:21:00 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be41adc-ee2c-42e6-878b-753c66f49282]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:00 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723b1aa-1054-4cdf-8b5d-43e23a54cb0b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 Sep 28 18:21:00 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD Sep 28 18:21:00 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:21:00 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" returned: 0 in 0.526s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2184fde-ba93-42ab-be3c-2c3e7ee5a6df]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 Sep 28 18:21:00 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00" returned: 0 in 0.601s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1784249502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8380a31c-8aa7-4921-a184-70b107bcc2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d967648d7e47679dc37de1955cbfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:58Z,use_quota=True,user_id='26f3138989d642a2a0d162dc3442eb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Creating volume 8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:00 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:00 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00 Sep 28 18:21:00 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1073741824 Sep 28 18:21:00 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b6261dc-66e0-4921-999f-ef1f6172bd00" returned: 0 in 0.312s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" returned: 0 in 0.505s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-2b6261dc-66e0-4921-999f-ef1f6172bd00" released by "delete_volume" :: held 1.005s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:01 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 Sep 28 18:21:01 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Created reservations ['7495d19c-9791-433b-9dfe-d76fad489ed5', '618e930c-4ab0-4709-8720-5d49d84310ac', '11707d27-687d-4e0c-b411-e8908c713137', '978cccc7-982e-4e67-addb-091dd2b2b5c9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:01 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1073741824" returned: 0 in 0.673s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 Sep 28 18:21:01 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" returned: 0 in 0.554s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.351s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:01 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63 Sep 28 18:21:01 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Deleted volume successfully. Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f001aa29-af1f-4199-bad6-79537b9dfb21 tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-2b6261dc-66e0-4921-999f-ef1f6172bd00-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:01 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Attempting download of 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 8380a31c-8aa7-4921-a184-70b107bcc2d3. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1c5a1-9b91-41b4-92e6-740ed5364016]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3.4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" returned: 0 in 0.385s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63" released by "_delete_snapshot" :: held 2.156s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" released by "delete_snapshot" :: held 2.190s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw Sep 28 18:21:02 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Flow 'volume_create_manager' (9af4480f-d1e8-4ed9-bf67-e8f8bd0e09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df090a7f-767e-4c17-8694-cbc4f5af3962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df090a7f-767e-4c17-8694-cbc4f5af3962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1052276687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469dbf0c-13d8-4c86-8b94-2682baad2f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91b8179d5b14d3ea5d876144ee41feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:02Z,use_quota=True,user_id='ec49f98d93d74ccb9be6e43c2919683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eb1f2f-da9a-4734-9c67-9a6e372a8e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eb1f2f-da9a-4734-9c67-9a6e372a8e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08590533-6233-49c6-9efc-aeefc7cb15c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08590533-6233-49c6-9efc-aeefc7cb15c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469dbf0c-13d8-4c86-8b94-2682baad2f38', 'volume_name': 'volume-469dbf0c-13d8-4c86-8b94-2682baad2f38', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967bafe5-e0c9-4fd6-b011-83320951baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967bafe5-e0c9-4fd6-b011-83320951baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945cdbd2-abb8-46e4-8fcb-f043054e4ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Volume 469dbf0c-13d8-4c86-8b94-2682baad2f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469dbf0c-13d8-4c86-8b94-2682baad2f38', 'volume_size': 1} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1052276687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469dbf0c-13d8-4c86-8b94-2682baad2f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91b8179d5b14d3ea5d876144ee41feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:02Z,use_quota=True,user_id='ec49f98d93d74ccb9be6e43c2919683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Creating volume 469dbf0c-13d8-4c86-8b94-2682baad2f38 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:02 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 1073741824 Sep 28 18:21:02 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['1043fd01-5555-48e4-ba5e-a531d2ee2cec', 'efe0ff90-542e-49cd-b1ed-f40bb9003f3c', '0510b8a0-6414-4293-af34-52798aee3ff4', '8412e640-4a4e-450a-9987-0d6203d48285'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-7aff0fc6-94c2-40f7-ac55-3e1441c96feb-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Delete snapshot completed successfully. Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d4594e-b1d4-4bb1-8e58-a04b9e8c89d4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-4bb4bf7e-27d3-4d1c-9c1e-05b776814a63-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-7aff0fc6-94c2-40f7-ac55-3e1441c96feb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:02 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw" returned: 0 in 0.459s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "cinder-quobyte-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fdaf08-5d7a-4163-8009-f2e20b1356dc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw Sep 28 18:21:02 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb Sep 28 18:21:02 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 1073741824" returned: 0 in 0.545s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw" returned: 1 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_v5g_1bnw' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec13fa-aa44-4055-9304-a721470c7a2e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 Sep 28 18:21:02 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD Sep 28 18:21:02 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" returned: 0 in 0.501s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb Sep 28 18:21:03 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38" returned: 0 in 0.317s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945cdbd2-abb8-46e4-8fcb-f043054e4ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469dbf0c-13d8-4c86-8b94-2682baad2f38', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f74f50-6c2c-4903-a50d-1827d7823e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Volume volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 (469dbf0c-13d8-4c86-8b94-2682baad2f38): created successfully Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f74f50-6c2c-4903-a50d-1827d7823e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Flow 'volume_create_manager' (9af4480f-d1e8-4ed9-bf67-e8f8bd0e09dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-032491af-c05e-47cc-9c13-058228e309e2 tempest-VolumesServicesTestJSON-253976653 None] Created volume successfully. Sep 28 18:21:03 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 Sep 28 18:21:03 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" returned: 0 in 0.309s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-quobyte-7aff0fc6-94c2-40f7-ac55-3e1441c96feb" released by "delete_volume" :: held 0.869s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Created reservations ['dc4ccd21-6037-492d-805b-c2c2ce1349e8', 'fcd5f5ec-6678-48b6-ade6-1bc29595f5e1', '04d50c8c-db9b-4578-86be-a0a25d7e7239', '1baf66fc-66bc-4e46-b4b8-a6fb5161c505'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:03 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (551c6353-807e-48c2-bc29-c2e7ce1734ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4423b528-b0e8-4887-a30f-c3263b37f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4423b528-b0e8-4887-a30f-c3263b37f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665570727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:04Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f841482-2db3-4139-97dc-0c547254e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f841482-2db3-4139-97dc-0c547254e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1b336-e167-40ab-810f-82c0f505b924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1b336-e167-40ab-810f-82c0f505b924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610', 'volume_name': 'volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29168e5-5649-413a-98b7-df36a2d93c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29168e5-5649-413a-98b7-df36a2d93c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cd4236-e35f-4ae7-96a8-c41361c8513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Volume 4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610', 'volume_size': 1} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665570727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:04Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Creating volume 4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 1073741824 Sep 28 18:21:03 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.453s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Deleted volume successfully. Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d40dfa99-6e7c-4c89-83c1-d732e281c00a tempest-AttachVolumeTestJSON-407998149 None] Lock "cinder-7aff0fc6-94c2-40f7-ac55-3e1441c96feb-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Acquiring lock "cinder-469dbf0c-13d8-4c86-8b94-2682baad2f38-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "cinder-469dbf0c-13d8-4c86-8b94-2682baad2f38-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Acquiring lock "cinder-quobyte-469dbf0c-13d8-4c86-8b94-2682baad2f38" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "cinder-quobyte-469dbf0c-13d8-4c86-8b94-2682baad2f38" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[39442fdf-06e1-4b2e-85a2-f0feab4c1927]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 1073741824" returned: 0 in 0.804s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:04 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 Sep 28 18:21:04 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.355s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cd4236-e35f-4ae7-96a8-c41361c8513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd007446-f587-4656-9b27-a8a4ec432a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Volume volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 (4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610): created successfully Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd007446-f587-4656-9b27-a8a4ec432a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (551c6353-807e-48c2-bc29-c2e7ce1734ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:05 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-890dcd4d-4c93-4fb3-9427-b33b2bd7f5df tempest-VolumesSnapshotTestJSON-403957920 None] Created volume successfully. Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38" returned: 0 in 0.577s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38 Sep 28 18:21:05 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-469dbf0c-13d8-4c86-8b94-2682baad2f38" returned: 0 in 0.300s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "cinder-quobyte-469dbf0c-13d8-4c86-8b94-2682baad2f38" released by "delete_volume" :: held 0.937s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Created reservations ['f9df7375-d9ca-4459-aa85-48c0efb48168', 'f0a5843b-d5f9-4167-a673-002a47311953', '83ca5034-a275-407b-90ce-078f17188f9e', '0782fe8f-8db1-46d4-909e-a8f46a2bee63'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:05 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3" returned: 0 in 2.925s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_gkpfvpicdevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:21:06 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Converted 112.00 MB image at 38.27 MB/s Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:06 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1G Sep 28 18:21:06 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Creating offline snapshot 1573a387-d74d-4f03-b1f2-d441c950a121 of volume 4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:06 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.424s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771ce16-8ea4-4995-b1a7-0638ad7f6843]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Deleted volume successfully. Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0cd153b9-19f3-4632-b4c7-9c035a68b243 tempest-VolumesServicesTestJSON-253976653 None] Lock "cinder-469dbf0c-13d8-4c86-8b94-2682baad2f38-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:06 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:06 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 1G" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Downloaded image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 8380a31c-8aa7-4921-a184-70b107bcc2d3 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 for user 26f3138989d642a2a0d162dc3442eb84 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Marking volume 8380a31c-8aa7-4921-a184-70b107bcc2d3 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Copying metadata from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 to 8380a31c-8aa7-4921-a184-70b107bcc2d3. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Creating volume glance metadata for volume 8380a31c-8aa7-4921-a184-70b107bcc2d3 backed by image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7a06f-6729-4953-b8ea-0873d4d9e5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8380a31c-8aa7-4921-a184-70b107bcc2d3', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ac25d-7019-461c-bcee-e06ea6153abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:06 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.438s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Volume volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 (8380a31c-8aa7-4921-a184-70b107bcc2d3): created successfully Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ac25d-7019-461c-bcee-e06ea6153abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:06 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 1G Sep 28 18:21:06 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Flow 'volume_create_manager' (fa6f4fa9-da5a-4f9f-b606-77cd0dcf0b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b8bc4692-f5cd-464e-a633-7f8736f77a97 tempest-VolumesExtendTest-1374775086 None] Created volume successfully. Sep 28 18:21:07 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 1G" returned: 0 in 0.592s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:07 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.375s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 is being set with open permissions: ugo+rw Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:07 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:07 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info Sep 28 18:21:08 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info is being set with open permissions: ugo+rw Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info Sep 28 18:21:08 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.info" returned: 0 in 0.280s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.906s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bc5f5255-cc98-484d-a5c2-3b28cd61d4a9 tempest-VolumesSnapshotTestJSON-403957920 None] Create snapshot completed successfully Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[df655fa3-c21c-4942-bc36-cce3eb942119]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 Sep 28 18:21:08 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3" returned: 0 in 0.491s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 2G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 2G" returned: 0 in 0.180s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.722s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2b7b333e-317c-4f54-9353-30439e715dc1 tempest-VolumesExtendTest-1374775086 None] Extend volume completed successfully. Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (19e61c61-47a0-4475-9ade-740c29de48ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d050949-7361-4b63-84c6-c383ee3bf4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d050949-7361-4b63-84c6-c383ee3bf4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815987112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1573a387-d74d-4f03-b1f2-d441c950a121,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:10Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b4156c-dde3-4515-bb0c-a5a0512b58f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b4156c-dde3-4515-bb0c-a5a0512b58f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdadf472-8509-4a0c-ad50-59b5f7907d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdadf472-8509-4a0c-ad50-59b5f7907d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2', 'volume_name': 'volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2', 'volume_size': 2, 'snapshot_id': '1573a387-d74d-4f03-b1f2-d441c950a121'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832144e3-7abe-4797-a0e0-a7a32f34b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832144e3-7abe-4797-a0e0-a7a32f34b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94d26f4-8870-4d13-9992-015ac4e5ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Volume 8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2', 'volume_size': 2, 'snapshot_id': '1573a387-d74d-4f03-b1f2-d441c950a121'} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Creating volume 8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 from snapshot 1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] snapshot: 1573a387-d74d-4f03-b1f2-d441c950a121, volume: 8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e868053-25a5-4765-b818-6c4d12ecf4f1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:10 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-8380a31c-8aa7-4921-a184-70b107bcc2d3-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "cinder-8380a31c-8aa7-4921-a184-70b107bcc2d3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-quobyte-8380a31c-8aa7-4921-a184-70b107bcc2d3" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-8380a31c-8aa7-4921-a184-70b107bcc2d3" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b796cae-cd2d-4368-a5ef-db7fbf2fc727]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 Sep 28 18:21:10 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.574s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938ae6b-4b81-4831-b99e-eafc0cda9239]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:11 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3" returned: 0 in 0.497s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3 Sep 28 18:21:11 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.497s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 Sep 28 18:21:11 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8380a31c-8aa7-4921-a184-70b107bcc2d3" returned: 0 in 0.335s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-8380a31c-8aa7-4921-a184-70b107bcc2d3" released by "delete_volume" :: held 0.905s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Created reservations ['eae6d28c-3b33-4a7e-8ebf-88e086301b11', '77978221-3237-4f17-894d-c8db08928719', 'b302d023-edd1-44b8-862a-860e530d8354', '073eebd9-f12d-4bd9-84b5-ca31fec92b11'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:11 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:12 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.388s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:12 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Deleted volume successfully. Sep 28 18:21:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cdb3bc28-aa3f-4299-9ed2-1e3bd88ed07b tempest-VolumesExtendTest-1374775086 None] Lock "cinder-8380a31c-8aa7-4921-a184-70b107bcc2d3-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Flow 'volume_create_manager' (f142e5d8-37bd-496d-95d6-a2cb8d85c67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6853b50-cb8f-498e-bdc1-c2505c896cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6853b50-cb8f-498e-bdc1-c2505c896cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861603904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189b6eee-d058-478c-b5ba-844e198ef520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d967648d7e47679dc37de1955cbfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='26f3138989d642a2a0d162dc3442eb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab139e2-f987-40a6-b95b-f75e589dcd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab139e2-f987-40a6-b95b-f75e589dcd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e519a8-f4b8-42c2-b697-b6c1eaf1ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e519a8-f4b8-42c2-b697-b6c1eaf1ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189b6eee-d058-478c-b5ba-844e198ef520', 'volume_name': 'volume-189b6eee-d058-478c-b5ba-844e198ef520', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf35df14-9705-46c5-a988-fdac6249c3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf35df14-9705-46c5-a988-fdac6249c3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9667c4f-3703-4b9b-82a2-078892fbf709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Volume 189b6eee-d058-478c-b5ba-844e198ef520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189b6eee-d058-478c-b5ba-844e198ef520', 'volume_size': 1} Sep 28 18:21:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Flow 'volume_create_manager' (a9ae1ec3-0e00-4aee-a0b2-195ab2792031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e058a3-a3ce-4cbc-882c-b386a25fdcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e058a3-a3ce-4cbc-882c-b386a25fdcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1331556733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48609f-bfd9-4fb8-903f-85b213651a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33925ba7bd0d469a902c1b9813c45e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:19Z,use_quota=True,user_id='2a317f8b5f2d447f8e5bb071b13fb236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785f482-b853-4129-9558-aba011b9adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785f482-b853-4129-9558-aba011b9adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca4d22-f595-408b-b77e-5f4452fb6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca4d22-f595-408b-b77e-5f4452fb6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc48609f-bfd9-4fb8-903f-85b213651a7d', 'volume_name': 'volume-cc48609f-bfd9-4fb8-903f-85b213651a7d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a812e-16c0-4525-9f34-d792a99dddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a812e-16c0-4525-9f34-d792a99dddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acb6045-3a7d-4068-b432-2913ebcae455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Volume cc48609f-bfd9-4fb8-903f-85b213651a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc48609f-bfd9-4fb8-903f-85b213651a7d', 'volume_size': 1} Sep 28 18:21:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:20 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" returned: 0 in 9.114s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:20 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610, size 1024.00 MB, duration 9.12 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:21:20 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Converted 1024.00 MB image at 112.34 MB/s Sep 28 18:21:20 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 is being set with open permissions: ugo+rw Sep 28 18:21:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:20 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 Sep 28 18:21:20 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:20 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" released by "_copy_volume_from_snapshot" :: held 10.643s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" released by "_create_volume_from_snapshot" :: held 10.916s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.936s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.441s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861603904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189b6eee-d058-478c-b5ba-844e198ef520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d967648d7e47679dc37de1955cbfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='26f3138989d642a2a0d162dc3442eb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Creating volume 189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:21 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 1073741824 Sep 28 18:21:21 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94d26f4-8870-4d13-9992-015ac4e5ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2', 'volume_size': 2, 'snapshot_id': '1573a387-d74d-4f03-b1f2-d441c950a121'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a5b552-b87c-488f-b571-ceace9c8721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Volume volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 (8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2): created successfully Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a5b552-b87c-488f-b571-ceace9c8721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (19e61c61-47a0-4475-9ade-740c29de48ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-629245aa-792f-45ac-aaf0-7277777368c4 tempest-VolumesSnapshotTestJSON-403957920 None] Created volume successfully. Sep 28 18:21:21 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 1073741824" returned: 0 in 0.510s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:21 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:21 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:22 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.266s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.818s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1331556733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48609f-bfd9-4fb8-903f-85b213651a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33925ba7bd0d469a902c1b9813c45e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:19Z,use_quota=True,user_id='2a317f8b5f2d447f8e5bb071b13fb236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Creating volume cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:22 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9667c4f-3703-4b9b-82a2-078892fbf709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189b6eee-d058-478c-b5ba-844e198ef520', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:22 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d 1073741824 Sep 28 18:21:22 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9af2f-8670-4f6d-8860-20d8dbad61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Volume volume-189b6eee-d058-478c-b5ba-844e198ef520 (189b6eee-d058-478c-b5ba-844e198ef520): created successfully Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9af2f-8670-4f6d-8860-20d8dbad61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Flow 'volume_create_manager' (f142e5d8-37bd-496d-95d6-a2cb8d85c67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2636e3dc-c312-4883-8a9a-842ba369f687 tempest-VolumesExtendTest-1374775086 None] Created volume successfully. Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c24230-685b-40d9-a157-d690ec147890]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d 1073741824" returned: 0 in 0.650s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d Sep 28 18:21:22 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:22 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 Sep 28 18:21:22 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d" returned: 0 in 0.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acb6045-3a7d-4068-b432-2913ebcae455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc48609f-bfd9-4fb8-903f-85b213651a7d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8681c4fc-2426-4d6b-97d7-99804e6d4f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:23 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Volume volume-cc48609f-bfd9-4fb8-903f-85b213651a7d (cc48609f-bfd9-4fb8-903f-85b213651a7d): created successfully Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8681c4fc-2426-4d6b-97d7-99804e6d4f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Flow 'volume_create_manager' (a9ae1ec3-0e00-4aee-a0b2-195ab2792031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:23 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2d68c0c1-95ae-45fd-af8f-e1ce1f4c4f81 tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Created volume successfully. Sep 28 18:21:23 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" returned: 0 in 0.598s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2 Sep 28 18:21:23 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Creating offline snapshot 88da4467-864e-40e8-ada5-7a14962a0db1 of volume 189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d48bc85-5a01-4134-8647-b51062e21487]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2" released by "delete_volume" :: held 1.057s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:23 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:23 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['a01a595d-66af-4e68-a742-4a206fc52a14', 'b0715368-0d5a-47a7-8e00-4fbe28460335', '40cda1e8-1058-4f45-a914-45f8af50801b', '4998749c-280f-4634-92c8-21d5d1fec6f4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:23 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.456s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 1G Sep 28 18:21:24 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.321s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Deleted volume successfully. Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-992dd0ed-5c9e-434b-bcc9-34281e0adb95 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-8f1e5e92-e49e-43cc-b0c3-bfeb60053fe2-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:24 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 1G" returned: 0 in 0.637s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b6eee-d058-478c-b5ba-844e198ef520 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:24 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b6eee-d058-478c-b5ba-844e198ef520 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 Sep 28 18:21:24 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-1573a387-d74d-4f03-b1f2-d441c950a121-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-1573a387-d74d-4f03-b1f2-d441c950a121-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Deleting offline snapshot 1573a387-d74d-4f03-b1f2-d441c950a121 of volume 4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] snapshot_file for this snap is: volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb2c32-2166-481c-95bb-b1c51937cb4d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b6eee-d058-478c-b5ba-844e198ef520 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1" returned: 0 in 0.437s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 is being set with open permissions: ugo+rw Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 Sep 28 18:21:25 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:25 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.439s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e413aa-b27e-4c71-92f2-b9e8b175dda8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info Sep 28 18:21:25 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:25 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info" returned: 0 in 0.430s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info is being set with open permissions: ugo+rw Sep 28 18:21:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info Sep 28 18:21:25 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.747s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.info" returned: 0 in 0.315s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:26 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.585s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Creating offline snapshot 3db528f8-2716-481e-9ce2-63d486b6080f of volume cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c61ecf4f-0972-4cd4-834a-f0a8a633be12 tempest-VolumesExtendTest-1374775086 None] Create snapshot completed successfully Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07343d-5fc3-42aa-b0e0-a52e6528d0e6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d Sep 28 18:21:26 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.485s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121 Sep 28 18:21:26 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d" returned: 0 in 0.530s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:26 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f 1G Sep 28 18:21:26 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610.1573a387-d74d-4f03-b1f2-d441c950a121" returned: 0 in 0.341s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-1573a387-d74d-4f03-b1f2-d441c950a121" released by "_delete_snapshot" :: held 2.161s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" released by "delete_snapshot" :: held 2.192s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['6728c956-645b-4b94-b782-ce66663b3452', 'c1b6d56e-d909-4127-b4bc-58e899b68d6a', 'ac7a6aac-9acd-4e6b-90a5-43b08156e2c3', '39948c62-ddcc-4646-8248-cd5d985b51a3'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Delete snapshot completed successfully. Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c171002-57c1-40e0-9d41-3337483e34fd tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-1573a387-d74d-4f03-b1f2-d441c950a121-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:27 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f 1G" returned: 0 in 0.563s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc48609f-bfd9-4fb8-903f-85b213651a7d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc48609f-bfd9-4fb8-903f-85b213651a7d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f Sep 28 18:21:27 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc48609f-bfd9-4fb8-903f-85b213651a7d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f" returned: 0 in 0.325s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f is being set with open permissions: ugo+rw Sep 28 18:21:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f Sep 28 18:21:27 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info Sep 28 18:21:28 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a228a8-c93d-4984-a78d-3a25e3853f7e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info" returned: 0 in 0.346s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info is being set with open permissions: ugo+rw Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info Sep 28 18:21:28 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:28 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.info" returned: 0 in 0.325s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.927s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[031f5914-fa49-4e77-a02b-d8980abf9b81]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.489s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5ee2e7eb-eec6-42f6-abe2-c59f2b86a1fc tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Create snapshot completed successfully Sep 28 18:21:28 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610 Sep 28 18:21:28 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:29 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:29 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:29 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610" released by "delete_volume" :: held 0.873s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['6695b7f4-ff82-424c-bf1a-d9d5ea153480', 'c35cd38a-f162-4ebd-9ebe-bcb5a455a946', 'ba35d8bc-9dbf-42f7-97fb-585a889f2c76', 'e8af3828-36aa-4884-bfe9-2b6b0e817e32'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:29 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.471s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 2G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:29 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 2G" returned: 0 in 0.242s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.784s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-25334190-986c-4dbe-a55f-b5088a461e6e tempest-VolumesExtendTest-1374775086 None] Extend volume completed successfully. Sep 28 18:21:29 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.379s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Deleted volume successfully. Sep 28 18:21:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e29f5a25-4cd1-484c-a3d3-45bfb513f2b6 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-4ebab9a1-1cd5-4f53-aa9a-ddc9c448d610-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-88da4467-864e-40e8-ada5-7a14962a0db1-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (2549632a-3568-437a-af24-df9c7c532208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ccea24-4113-47b0-981e-d876157a0bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-88da4467-864e-40e8-ada5-7a14962a0db1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ccea24-4113-47b0-981e-d876157a0bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2103967704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28656799-0ebd-4533-8810-44b7ef6f0bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac77f2a-75ab-4114-830e-94d898cf1684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac77f2a-75ab-4114-830e-94d898cf1684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e23fb8-3af3-4420-b4f2-a84ad1a03bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e23fb8-3af3-4420-b4f2-a84ad1a03bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28656799-0ebd-4533-8810-44b7ef6f0bee', 'volume_name': 'volume-28656799-0ebd-4533-8810-44b7ef6f0bee', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cb6aae-f5a0-4c1a-be73-646cd0d99068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cb6aae-f5a0-4c1a-be73-646cd0d99068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4abca4c-3365-49bb-8ab6-942113a25b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Volume 28656799-0ebd-4533-8810-44b7ef6f0bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28656799-0ebd-4533-8810-44b7ef6f0bee', 'volume_size': 1} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2103967704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28656799-0ebd-4533-8810-44b7ef6f0bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Creating volume 28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:30 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" acquired by "delete_snapshot" :: waited 0.145s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-quobyte-88da4467-864e-40e8-ada5-7a14962a0db1" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee 1073741824 Sep 28 18:21:30 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-88da4467-864e-40e8-ada5-7a14962a0db1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Deleting offline snapshot 88da4467-864e-40e8-ada5-7a14962a0db1 of volume 189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] snapshot_file for this snap is: volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ecd82e-2a02-405a-9956-2898aa64f35e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "cinder-3db528f8-2716-481e-9ce2-63d486b6080f-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-3db528f8-2716-481e-9ce2-63d486b6080f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "cinder-quobyte-3db528f8-2716-481e-9ce2-63d486b6080f" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-3db528f8-2716-481e-9ce2-63d486b6080f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Deleting offline snapshot 3db528f8-2716-481e-9ce2-63d486b6080f of volume cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] snapshot_file for this snap is: volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:31 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 Sep 28 18:21:31 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b19296f-604a-4560-8a19-5de83576ffa6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f Sep 28 18:21:31 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee 1073741824" returned: 0 in 0.710s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1" returned: 0 in 0.620s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189b6eee-d058-478c-b5ba-844e198ef520(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca601fb6-2a2e-40c8-a76b-076b8c9e88d3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:31 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f" returned: 0 in 0.508s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc48609f-bfd9-4fb8-903f-85b213651a7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47cd7d9-faac-435c-a191-55e1cc002562]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:31 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d Sep 28 18:21:31 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.356s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4abca4c-3365-49bb-8ab6-942113a25b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28656799-0ebd-4533-8810-44b7ef6f0bee', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a396ef1-b202-4a74-92f3-21aed04c6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Volume volume-28656799-0ebd-4533-8810-44b7ef6f0bee (28656799-0ebd-4533-8810-44b7ef6f0bee): created successfully Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a396ef1-b202-4a74-92f3-21aed04c6c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (2549632a-3568-437a-af24-df9c7c532208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9cf343a4-2238-434d-b2b7-c6b8c5014b01 tempest-VolumesSnapshotTestJSON-403957920 None] Created volume successfully. Sep 28 18:21:31 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.543s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 Sep 28 18:21:32 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:32 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d" returned: 0 in 0.484s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f Sep 28 18:21:32 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:32 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1" returned: 0 in 0.514s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1 Sep 28 18:21:32 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:32 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f" returned: 0 in 0.539s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f Sep 28 18:21:32 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Creating offline snapshot 0edd61f9-0367-46f3-9f76-4755681f8797 of volume 28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3fd1bd-99bc-47b6-8d33-c23b9f171ec9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520.88da4467-864e-40e8-ada5-7a14962a0db1" returned: 0 in 0.472s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-88da4467-864e-40e8-ada5-7a14962a0db1" released by "_delete_snapshot" :: held 2.332s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d.3db528f8-2716-481e-9ce2-63d486b6080f" returned: 0 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" released by "delete_snapshot" :: held 2.371s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:33 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-3db528f8-2716-481e-9ce2-63d486b6080f" released by "_delete_snapshot" :: held 2.154s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" released by "delete_snapshot" :: held 2.204s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Created reservations ['bae667ec-aa0a-4c9b-82b4-f0cd584c830d', '7085accd-f673-4915-97b9-cd938a13d7c5', '2f2caa59-6924-4e07-b69e-885f1fe947d5', '792b7913-9e00-407b-a25f-d13fcf717c11'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Created reservations ['8c6a76fa-176d-4086-a70e-03d6134574cb', '7346fdd0-5b9c-4e7d-8f94-4559510924c9', '84cbe95d-4ded-498a-bf19-f8727ac86a61', '4444acfe-2eba-47d4-80aa-185bbda6a362'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Delete snapshot completed successfully. Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c79d358-6024-4a45-bdf5-7cddd5a29ab6 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-88da4467-864e-40e8-ada5-7a14962a0db1-delete_snapshot" released by "delete_snapshot" :: held 2.769s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Delete snapshot completed successfully. Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc2a851f-f8cd-4c97-b4a1-9d30ad89c12d tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-3db528f8-2716-481e-9ce2-63d486b6080f-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.466s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 1G Sep 28 18:21:33 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-189b6eee-d058-478c-b5ba-844e198ef520-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-189b6eee-d058-478c-b5ba-844e198ef520-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=160,cinder:UPDATE=168,cinder:INSERT=44,cinder:DELETE=19 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b484db0a-3289-4630-8dc4-a41019d393df]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 1G" returned: 0 in 0.584s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28656799-0ebd-4533-8810-44b7ef6f0bee -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28656799-0ebd-4533-8810-44b7ef6f0bee -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:34 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:34 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "cinder-cc48609f-bfd9-4fb8-903f-85b213651a7d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-cc48609f-bfd9-4fb8-903f-85b213651a7d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" acquired by "delete_volume" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[194dfb3e-36ec-4fde-afe0-3c10b2d15b9c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28656799-0ebd-4533-8810-44b7ef6f0bee -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 0.444s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 is being set with open permissions: ugo+rw Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:34 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.533s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520 Sep 28 18:21:34 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d Sep 28 18:21:34 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-189b6eee-d058-478c-b5ba-844e198ef520" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-quobyte-189b6eee-d058-478c-b5ba-844e198ef520" released by "delete_volume" :: held 0.946s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info Sep 28 18:21:34 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d" returned: 0 in 0.506s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Created reservations ['85802a56-2c5c-418d-b238-443b51524cc2', 'c92f37e7-2600-4683-8ef8-0402bd3dc5b9', 'fbec9e33-b515-4ade-96e4-2aab89a78598', '72a2304c-eb68-448a-98bc-56df86e8e4d1'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:34 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d Sep 28 18:21:34 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:35 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc48609f-bfd9-4fb8-903f-85b213651a7d" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info" returned: 0 in 0.425s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info is being set with open permissions: ugo+rw Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-quobyte-cc48609f-bfd9-4fb8-903f-85b213651a7d" released by "delete_volume" :: held 0.953s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:35 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info Sep 28 18:21:35 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Created reservations ['7a8eb562-68ed-4abf-90f4-3549cf392319', 'f901d8e1-833c-42b9-8df8-9b2476cb0ede', 'f5142f3a-08fe-4614-b9e6-c0930d195596', '1abb6141-99da-4b1d-9834-c121c0ec8bdd'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:35 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Deleted volume successfully. Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f9b0c9c-cd0b-449d-b826-cd169ae7d5e5 tempest-VolumesExtendTest-1374775086 None] Lock "cinder-189b6eee-d058-478c-b5ba-844e198ef520-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:35 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.info" returned: 0 in 0.374s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9aa3bf83-6c2a-45b1-a645-bb8851f6921d tempest-VolumesSnapshotTestJSON-403957920 None] Create snapshot completed successfully Sep 28 18:21:35 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Deleted volume successfully. Sep 28 18:21:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a6ade30d-d3b5-453b-91d1-88a3e30db29e tempest-VolumeSnapshotQuotasNegativeTestJSON-972499022 None] Lock "cinder-cc48609f-bfd9-4fb8-903f-85b213651a7d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (33dbca89-5956-44fb-9c76-e71823d6dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd05ce-d895-4df0-89a3-ec878bcacae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd05ce-d895-4df0-89a3-ec878bcacae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-397044345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1349b5-a841-411c-9ad2-7ca906bd94d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d0e5cb5d77423cbca9e755ecc73761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0edd61f9-0367-46f3-9f76-4755681f8797,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:37Z,use_quota=True,user_id='953d8e978fc943ed86ae8b3360f053fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad84971-54bd-40c7-87a2-1ea235f4f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad84971-54bd-40c7-87a2-1ea235f4f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12dbd1a-72e5-4f6d-bb3f-5ad4d24d4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12dbd1a-72e5-4f6d-bb3f-5ad4d24d4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb1349b5-a841-411c-9ad2-7ca906bd94d4', 'volume_name': 'volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4', 'volume_size': 1, 'snapshot_id': '0edd61f9-0367-46f3-9f76-4755681f8797'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e6b6a5-b5b8-469a-8d5d-2a7bc8ac8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e6b6a5-b5b8-469a-8d5d-2a7bc8ac8373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b73df5-6795-4ff5-b257-66ec29986c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Volume eb1349b5-a841-411c-9ad2-7ca906bd94d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4', 'volume_size': 1, 'snapshot_id': '0edd61f9-0367-46f3-9f76-4755681f8797'} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797-eb1349b5-a841-411c-9ad2-7ca906bd94d4" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797-eb1349b5-a841-411c-9ad2-7ca906bd94d4" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Creating volume eb1349b5-a841-411c-9ad2-7ca906bd94d4 from snapshot 0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] snapshot: 0edd61f9-0367-46f3-9f76-4755681f8797, volume: eb1349b5-a841-411c-9ad2-7ca906bd94d4, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e812cb1-5a21-46da-823a-fad225cbd67d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:37 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 0.532s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28656799-0ebd-4533-8810-44b7ef6f0bee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[160533c3-c6dd-4a7d-b5b3-eac7c230b4e9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:37 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.663s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:21:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:21:38 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:21:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 Sep 28 18:21:38 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=176,cinder:SELECT=148,cinder:INSERT=52,cinder:DELETE=11 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (c8354a1d-6496-4866-8a8b-dce0e17ac63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b46dcb-88a7-4ab3-a84c-a0e0a35e7e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b46dcb-88a7-4ab3-a84c-a0e0a35e7e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1120723177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f386c2-60d3-4d68-bff0-8246e4a4d39c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:46Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363945e5-5095-4950-826f-bad18a1e9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363945e5-5095-4950-826f-bad18a1e9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a28322f-7186-41f6-a7e2-44604770d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a28322f-7186-41f6-a7e2-44604770d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f386c2-60d3-4d68-bff0-8246e4a4d39c', 'volume_name': 'volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d33b03-5ade-487c-9784-f0fdcc5816c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d33b03-5ade-487c-9784-f0fdcc5816c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fda382-7bcf-4e2e-8c56-3103b5faa180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Volume 70f386c2-60d3-4d68-bff0-8246e4a4d39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c', 'volume_size': 1} Sep 28 18:21:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:49 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4" returned: 0 in 11.422s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:49 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee, size 1024.00 MB, duration 11.42 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:21:49 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Converted 1024.00 MB image at 89.65 MB/s Sep 28 18:21:49 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 is being set with open permissions: ugo+rw Sep 28 18:21:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:49 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 Sep 28 18:21:49 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:50 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4" returned: 0 in 0.401s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" released by "_copy_volume_from_snapshot" :: held 13.158s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797-eb1349b5-a841-411c-9ad2-7ca906bd94d4" released by "_create_volume_from_snapshot" :: held 13.263s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.291s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1120723177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f386c2-60d3-4d68-bff0-8246e4a4d39c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:46Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Creating volume 70f386c2-60d3-4d68-bff0-8246e4a4d39c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:50 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:50 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c 1073741824 Sep 28 18:21:50 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b73df5-6795-4ff5-b257-66ec29986c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4', 'volume_size': 1, 'snapshot_id': '0edd61f9-0367-46f3-9f76-4755681f8797'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766cc7fe-69b0-4fdd-b7fb-8db9fedffcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Volume volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 (eb1349b5-a841-411c-9ad2-7ca906bd94d4): created successfully Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766cc7fe-69b0-4fdd-b7fb-8db9fedffcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Flow 'volume_create_manager' (33dbca89-5956-44fb-9c76-e71823d6dc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fc060eb6-ea0e-4cf5-9e55-290dab0040aa tempest-VolumesSnapshotTestJSON-403957920 None] Created volume successfully. Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-eb1349b5-a841-411c-9ad2-7ca906bd94d4-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-eb1349b5-a841-411c-9ad2-7ca906bd94d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e389037-4f83-4086-875a-60de315eda0d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:51 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c 1073741824" returned: 0 in 0.876s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:51 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 Sep 28 18:21:51 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:51 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c Sep 28 18:21:51 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:51 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c" returned: 0 in 0.352s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fda382-7bcf-4e2e-8c56-3103b5faa180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a785fb-58fb-41e0-b418-f9d4cd3baefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Volume volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c (70f386c2-60d3-4d68-bff0-8246e4a4d39c): created successfully Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a785fb-58fb-41e0-b418-f9d4cd3baefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (c8354a1d-6496-4866-8a8b-dce0e17ac63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f0e8f43b-440f-4791-a20f-6ef650bef0e3 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:21:51 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4" returned: 0 in 0.753s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:51 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4 Sep 28 18:21:51 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb1349b5-a841-411c-9ad2-7ca906bd94d4" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-eb1349b5-a841-411c-9ad2-7ca906bd94d4" released by "delete_volume" :: held 1.210s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['b6ed5ad8-8a97-44c2-9c45-a68d52d5dfb5', '7180d4c5-c663-48ed-bd9f-2ed26ef0d97c', 'a920886e-5cc4-42d4-add3-92f08b01ee32', 'c8d2560d-9962-4e37-8e75-74dafaa11e89'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:52 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:52 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.592s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Deleted volume successfully. Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1524965c-b3d5-4937-b804-a5ac7da3f4da tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-eb1349b5-a841-411c-9ad2-7ca906bd94d4-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Flow 'volume_create_manager' (8033b5f8-d7ec-4eb5-a939-9da87fb6fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b4b401-90f7-4cc7-bc14-9272213e9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-0edd61f9-0367-46f3-9f76-4755681f8797-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b4b401-90f7-4cc7-bc14-9272213e9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1789956312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e379d27-cbc3-4238-b362-bafe61716f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e340cfda641ef97b431de5c7b88d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:53Z,use_quota=True,user_id='c57a579555704caaae031f91608f5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f58a4e5-3130-4d48-9561-5433d844e5ed),volume_type_id=8f58a4e5-3130-4d48-9561-5433d844e5ed)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2671a4c-3525-496e-a866-db226d440bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2671a4c-3525-496e-a866-db226d440bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba623b8-7dcd-415f-a474-675b8f70cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba623b8-7dcd-415f-a474-675b8f70cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e379d27-cbc3-4238-b362-bafe61716f1b', 'volume_name': 'volume-3e379d27-cbc3-4238-b362-bafe61716f1b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f473e881-4095-4b9b-af3e-e7f4f40b1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f473e881-4095-4b9b-af3e-e7f4f40b1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e123fc9-2da3-4ef4-b7f9-810ff577dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Volume 3e379d27-cbc3-4238-b362-bafe61716f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e379d27-cbc3-4238-b362-bafe61716f1b', 'volume_size': 1} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1789956312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e379d27-cbc3-4238-b362-bafe61716f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e340cfda641ef97b431de5c7b88d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:53Z,use_quota=True,user_id='c57a579555704caaae031f91608f5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f58a4e5-3130-4d48-9561-5433d844e5ed),volume_type_id=8f58a4e5-3130-4d48-9561-5433d844e5ed)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Creating volume 3e379d27-cbc3-4238-b362-bafe61716f1b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:53 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-0edd61f9-0367-46f3-9f76-4755681f8797-delete_snapshot" acquired by "delete_snapshot" :: waited 0.147s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:53 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b 1073741824 Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:53 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Deleting offline snapshot 0edd61f9-0367-46f3-9f76-4755681f8797 of volume 28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] snapshot_file for this snap is: volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf7456-da3d-4519-ac23-c81ef4383b3d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:54 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (b72643f0-7058-45bc-8622-c9985cf73ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:54 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6aaca0-d54b-4606-b4af-5add7f6df702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b 1073741824" returned: 0 in 1.065s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6aaca0-d54b-4606-b4af-5add7f6df702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-422440496',display_name='tempest-VolumesGetTest-Volume-367135746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08abdb7a-2908-4d82-8b50-6f62006b3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:54Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07ea187-88ea-49bd-9bec-554c1324e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07ea187-88ea-49bd-9bec-554c1324e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b34d82-ff18-4b1d-afa9-e95b1ba67e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b34d82-ff18-4b1d-afa9-e95b1ba67e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08abdb7a-2908-4d82-8b50-6f62006b3eff', 'volume_name': 'volume-08abdb7a-2908-4d82-8b50-6f62006b3eff', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0c6417-80bd-430b-8dd4-7974acc76277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0c6417-80bd-430b-8dd4-7974acc76277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce1fbe-336f-4690-b225-d369bab1cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Volume 08abdb7a-2908-4d82-8b50-6f62006b3eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08abdb7a-2908-4d82-8b50-6f62006b3eff', 'volume_size': 1} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b Sep 28 18:21:54 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 1.078s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28656799-0ebd-4533-8810-44b7ef6f0bee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81bc11c-9602-4b78-88a9-ccd8141f85a0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:55 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-422440496',display_name='tempest-VolumesGetTest-Volume-367135746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08abdb7a-2908-4d82-8b50-6f62006b3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:54Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Creating volume 08abdb7a-2908-4d82-8b50-6f62006b3eff {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:55 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e123fc9-2da3-4ef4-b7f9-810ff577dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e379d27-cbc3-4238-b362-bafe61716f1b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff 1073741824 Sep 28 18:21:55 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a509d2c-81e1-43ab-bbbf-bf6c78c10cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Volume volume-3e379d27-cbc3-4238-b362-bafe61716f1b (3e379d27-cbc3-4238-b362-bafe61716f1b): created successfully Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a509d2c-81e1-43ab-bbbf-bf6c78c10cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Flow 'volume_create_manager' (8033b5f8-d7ec-4eb5-a939-9da87fb6fcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-608e14f3-5409-4617-9cbd-07d36191fd0f tempest-VolumeTypesAccessTest-480796403 None] Created volume successfully. Sep 28 18:21:55 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.860s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:55 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Acquiring lock "cinder-3e379d27-cbc3-4238-b362-bafe61716f1b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "cinder-3e379d27-cbc3-4238-b362-bafe61716f1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:55 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff 1073741824" returned: 0 in 0.796s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Acquiring lock "cinder-quobyte-3e379d27-cbc3-4238-b362-bafe61716f1b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "cinder-quobyte-3e379d27-cbc3-4238-b362-bafe61716f1b" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:55 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[990faa70-7048-422c-9d6b-ff5c39e34a09]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff Sep 28 18:21:56 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b Sep 28 18:21:56 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 0.517s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797 Sep 28 18:21:56 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce1fbe-336f-4690-b225-d369bab1cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08abdb7a-2908-4d82-8b50-6f62006b3eff', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd7e76-abf9-49a4-90a9-d142475f3a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Volume volume-08abdb7a-2908-4d82-8b50-6f62006b3eff (08abdb7a-2908-4d82-8b50-6f62006b3eff): created successfully Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd7e76-abf9-49a4-90a9-d142475f3a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (b72643f0-7058-45bc-8622-c9985cf73ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:56 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-946bb6c8-f8f9-407f-b940-048a9202acd9 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:21:56 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b" returned: 0 in 0.472s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b Sep 28 18:21:56 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee.0edd61f9-0367-46f3-9f76-4755681f8797" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-0edd61f9-0367-46f3-9f76-4755681f8797" released by "_delete_snapshot" :: held 2.981s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" released by "delete_snapshot" :: held 3.024s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['a34542af-6328-4fc0-8a05-9ab047fa7391', 'f2d43ff9-9df6-41db-8132-6d1ebb2f573f', 'd2726011-ae1c-4e0c-9fe9-5e4ddc0dd594', 'cebf3c11-5724-4625-87f0-c67f0485a16f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-08abdb7a-2908-4d82-8b50-6f62006b3eff-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:56 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Delete snapshot completed successfully. Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d061df83-3b2e-4958-b01a-9c7283f77273 tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-0edd61f9-0367-46f3-9f76-4755681f8797-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "cinder-08abdb7a-2908-4d82-8b50-6f62006b3eff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:56 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3e379d27-cbc3-4238-b362-bafe61716f1b" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "cinder-quobyte-3e379d27-cbc3-4238-b362-bafe61716f1b" released by "delete_volume" :: held 0.900s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-08abdb7a-2908-4d82-8b50-6f62006b3eff" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-08abdb7a-2908-4d82-8b50-6f62006b3eff" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:56 devstack cinder-volume[86560]: WARNING cinder.quota [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-898508281 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-898508281, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:56 devstack cinder-volume[86560]: WARNING cinder.quota [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-898508281 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-898508281, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe8efa-6435-4331-b1eb-6bf96d627c91]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Created reservations ['15f009b8-3112-4a77-94eb-c239c956aa23', 'abe39ead-365e-4870-9bad-35ee9133dbc3', 'bd93aa29-9ae9-4c38-ad75-4b2f2d7d6591', 'dea2dce8-0bb0-4c05-a720-08a93b67df92'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff Sep 28 18:21:57 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:57 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Deleted volume successfully. Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7699e98f-54f6-4cd0-8879-4ad111fd2818 tempest-VolumeTypesAccessTest-480796403 None] Lock "cinder-3e379d27-cbc3-4238-b362-bafe61716f1b-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:57 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff Sep 28 18:21:57 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08abdb7a-2908-4d82-8b50-6f62006b3eff" returned: 0 in 0.234s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-08abdb7a-2908-4d82-8b50-6f62006b3eff" released by "delete_volume" :: held 0.692s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Created reservations ['8883ffcd-ff29-4b6b-a163-3bd062aaefe3', 'cc1c7047-6461-4746-9aeb-278c662f8f16', 'cf36511c-1f4b-44a9-ab4f-525e9b82f72b', 'e00bca11-487a-4846-a12d-00d2e40b27d5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:57 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-28656799-0ebd-4533-8810-44b7ef6f0bee-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-28656799-0ebd-4533-8810-44b7ef6f0bee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" acquired by "delete_volume" :: waited 0.040s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22be540-b4c3-4326-8d82-a44858ffbaf1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-70f386c2-60d3-4d68-bff0-8246e4a4d39c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "cinder-70f386c2-60d3-4d68-bff0-8246e4a4d39c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-741ce67c-8bea-4c94-a2db-98d9183e885f tempest-VolumesGetTest-651685032 None] Lock "cinder-08abdb7a-2908-4d82-8b50-6f62006b3eff-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-70f386c2-60d3-4d68-bff0-8246e4a4d39c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-70f386c2-60d3-4d68-bff0-8246e4a4d39c" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:58 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6976f879-7d8e-4707-bd68-25f03f232a3c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c Sep 28 18:21:58 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.708s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee Sep 28 18:21:58 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c" returned: 0 in 0.611s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c Sep 28 18:21:59 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-28656799-0ebd-4533-8810-44b7ef6f0bee" returned: 0 in 0.392s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-28656799-0ebd-4533-8810-44b7ef6f0bee" released by "delete_volume" :: held 1.233s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:59 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-70f386c2-60d3-4d68-bff0-8246e4a4d39c" returned: 0 in 0.336s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['dc5e0fb2-f604-4487-b67b-0a2810082046', '5163a724-00a1-4290-82cb-b8e00d45a069', 'de52cd82-80cb-4e36-921c-9441843dc9d5', '1336c1af-59d0-4d73-b640-8abaf85900a9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-70f386c2-60d3-4d68-bff0-8246e4a4d39c" released by "delete_volume" :: held 1.017s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:59 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Created reservations ['dcb527af-ee64-4647-9264-454a8d3c1381', '339010ce-8847-4e3f-a8d8-84e246592119', 'b81cc8f0-1a6c-44b1-90a3-4197b21570e7', '5577134d-06e5-4dc2-9837-509d76be0595'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:21:59 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Deleted volume successfully. Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2b2e541e-ab32-4d1f-86ef-d282f9b5f3fa tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-28656799-0ebd-4533-8810-44b7ef6f0bee-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:59 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.288s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-17a2b4b9-7c72-4aea-a72c-613b5d119068 tempest-VolumesGetTest-651685032 None] Lock "cinder-70f386c2-60d3-4d68-bff0-8246e4a4d39c-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:00 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:00 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b98b97-4550-4248-94f3-f83ba9b78166]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 Sep 28 18:22:00 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" returned: 0 in 0.666s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3 Sep 28 18:22:01 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (e1837317-4c6d-4dc5-b566-998fffb9b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b1e9e2-2e7c-4a81-84dc-07bf4c533465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b1e9e2-2e7c-4a81-84dc-07bf4c533465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-277266397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c72312e-da67-42dc-a8c0-85853be1c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cbbd19-24ad-4fef-a613-33cc1404f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cbbd19-24ad-4fef-a613-33cc1404f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc48881-315e-41fc-b0d6-130d044594b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc48881-315e-41fc-b0d6-130d044594b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c72312e-da67-42dc-a8c0-85853be1c065', 'volume_name': 'volume-7c72312e-da67-42dc-a8c0-85853be1c065', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebbe7ac-20dc-4cf8-b659-1a5729b257cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebbe7ac-20dc-4cf8-b659-1a5729b257cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dedaa9-d455-434f-b71e-e12730d3ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Volume 7c72312e-da67-42dc-a8c0-85853be1c065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c72312e-da67-42dc-a8c0-85853be1c065', 'volume_size': 1} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-277266397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c72312e-da67-42dc-a8c0-85853be1c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Creating volume 7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:01 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 1073741824 Sep 28 18:22:01 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" returned: 0 in 0.390s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-quobyte-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3" released by "delete_volume" :: held 1.203s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Created reservations ['30b9a383-193e-48c1-a543-ccd02418c0e7', '0424983d-eb74-4f48-9c34-c56d489344a2', '67d97733-962d-4cfa-8bab-9470bbaf167a', '54df005d-282a-4bdd-91bd-669afba0220b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:01 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 1073741824" returned: 0 in 0.698s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:02 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Deleted volume successfully. Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6dc2dd15-f252-4b58-aec6-630c69c1a32c tempest-VolumesSnapshotTestJSON-403957920 None] Lock "cinder-30a08b8a-830a-4bcb-b8c9-44f08bb3b3e3-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:02 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.371s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dedaa9-d455-434f-b71e-e12730d3ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c72312e-da67-42dc-a8c0-85853be1c065', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a55fee0-0a7a-4d11-a1c6-6485c5c8e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Volume volume-7c72312e-da67-42dc-a8c0-85853be1c065 (7c72312e-da67-42dc-a8c0-85853be1c065): created successfully Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a55fee0-0a7a-4d11-a1c6-6485c5c8e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (e1837317-4c6d-4dc5-b566-998fffb9b9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-13c525b2-7c58-4bc7-b8b6-908d72412b95 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (370b0cfc-e1db-4043-91cf-b081373bd563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8535e9-b6d6-4c67-a3c6-f7bfb0f13c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8535e9-b6d6-4c67-a3c6-f7bfb0f13c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2137110789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf71ea39-088c-4bd6-a31c-b18459c2d1a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7c72312e-da67-42dc-a8c0-85853be1c065,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:04Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6acc8a-a265-4dc9-b8cc-75efbe4efdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6acc8a-a265-4dc9-b8cc-75efbe4efdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13725ca-1f3e-4745-98f6-ffee7c208f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13725ca-1f3e-4745-98f6-ffee7c208f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf71ea39-088c-4bd6-a31c-b18459c2d1a0', 'volume_name': 'volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0', 'volume_size': 1, 'source_volid': '7c72312e-da67-42dc-a8c0-85853be1c065', 'source_volstatus': 'available'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511c6fd0-6264-4424-ac9c-8531975b2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511c6fd0-6264-4424-ac9c-8531975b2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1084a3-fba6-48d5-b345-817f8b18518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Volume cf71ea39-088c-4bd6-a31c-b18459c2d1a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0', 'volume_size': 1, 'source_volid': '7c72312e-da67-42dc-a8c0-85853be1c065', 'source_volstatus': 'available'} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:04 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Cloning volume 7c72312e-da67-42dc-a8c0-85853be1c065 to volume cf71ea39-088c-4bd6-a31c-b18459c2d1a0 Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Creating offline snapshot 76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 of volume 7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31323f-ffce-402f-a695-ce19ce9d6bef]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:04 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 1G Sep 28 18:22:05 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 1G" returned: 0 in 0.539s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c72312e-da67-42dc-a8c0-85853be1c065 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c72312e-da67-42dc-a8c0-85853be1c065 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:05 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c72312e-da67-42dc-a8c0-85853be1c065 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 is being set with open permissions: ugo+rw Sep 28 18:22:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:05 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info Sep 28 18:22:06 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info" returned: 0 in 0.316s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info is being set with open permissions: ugo+rw Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info Sep 28 18:22:06 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.info" returned: 0 in 0.282s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] snapshot: 76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483, volume: cf71ea39-088c-4bd6-a31c-b18459c2d1a0, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409d24a-47f9-41ff-ae6d-51e7a6d4ac15]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:07 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c72312e-da67-42dc-a8c0-85853be1c065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5028f4-af00-46d2-9df4-18003b8e80dc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:07 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.545s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:22:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 Sep 28 18:22:07 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (3e7f42b0-e0d2-47f7-96c2-4405d5ef535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca149d6-67eb-48ad-aae2-db1604effb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca149d6-67eb-48ad-aae2-db1604effb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2092823030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74307b8e-48c5-4d67-ae20-cbff97e6f02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:16Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9678c044-c27d-4419-8f65-b9c090384a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9678c044-c27d-4419-8f65-b9c090384a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f65fc7-267e-48f1-a53a-77aa011d2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f65fc7-267e-48f1-a53a-77aa011d2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74307b8e-48c5-4d67-ae20-cbff97e6f02f', 'volume_name': 'volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca40966-313d-43a8-89e9-ec1f90c5a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca40966-313d-43a8-89e9-ec1f90c5a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea0ac6-9392-499c-8aba-f84864f24448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Volume 74307b8e-48c5-4d67-ae20-cbff97e6f02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f', 'volume_size': 1} Sep 28 18:22:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:17 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" returned: 0 in 9.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:17 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Converted 1024.00 MB image at 108.05 MB/s Sep 28 18:22:17 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 is being set with open permissions: ugo+rw Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:17 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 Sep 28 18:22:17 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" returned: 0 in 0.338s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" released by "_copy_volume_from_snapshot" :: held 10.902s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Flow 'volume_create_manager' (7aaa0599-5a4f-4e5f-a0f6-3e5ca06fcaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228716e9-f488-40a7-902b-ea7a45fed52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228716e9-f488-40a7-902b-ea7a45fed52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372691114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8eaab67cf84f6da980ada21b3ceab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:18Z,use_quota=True,user_id='544cbfe30b854780bbf063392eec4d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde2aafa-d802-48e8-81dd-ab55e6510128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde2aafa-d802-48e8-81dd-ab55e6510128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ceea71-1681-4978-b623-57ad39be4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ceea71-1681-4978-b623-57ad39be4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8', 'volume_name': 'volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8', 'volume_size': 2}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1108e4b-64cb-4714-a16d-c3a4dbc0f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1108e4b-64cb-4714-a16d-c3a4dbc0f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebfb503-f42c-498f-8334-f45e3478b9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Volume a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8', 'volume_size': 2} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" acquired by "_delete_snapshot" :: waited 0.111s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Deleting offline snapshot 76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 of volume 7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] snapshot_file for this snap is: volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2cf42-c8b7-4e7f-89f5-8d11de01ce94]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:18 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:18 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:18 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.405s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c72312e-da67-42dc-a8c0-85853be1c065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4156b-3abc-4540-9f6b-c1a27fdab7d2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:18 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:18 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:18 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.611s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:19 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:19 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:19 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:19 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483 Sep 28 18:22:19 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:19 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065.76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" returned: 0 in 0.284s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-76a3dbb5-1697-4e3f-a56b-c2ef1e6d0483" released by "_delete_snapshot" :: held 1.800s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.316s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.823s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2092823030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74307b8e-48c5-4d67-ae20-cbff97e6f02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:16Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Creating volume 74307b8e-48c5-4d67-ae20-cbff97e6f02f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:19 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1084a3-fba6-48d5-b345-817f8b18518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0', 'volume_size': 1, 'source_volid': '7c72312e-da67-42dc-a8c0-85853be1c065', 'source_volstatus': 'available'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:19 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f 1073741824 Sep 28 18:22:19 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c875ac-3e6a-4961-ba66-36cde2e22112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:19 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Volume volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 (cf71ea39-088c-4bd6-a31c-b18459c2d1a0): created successfully Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c875ac-3e6a-4961-ba66-36cde2e22112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (370b0cfc-e1db-4043-91cf-b081373bd563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4dad3ff7-3f0c-4292-af77-dbd7cea98574 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:22:20 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f 1073741824" returned: 0 in 0.555s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f Sep 28 18:22:20 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Flow 'volume_create_manager' (7eced237-9681-4846-8b70-dc71ab08de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88034982-cbdf-4c49-992c-75693a8b6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88034982-cbdf-4c49-992c-75693a8b6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-320006267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f305e6-b7c7-4047-8b57-41ee0536d06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec492bdf73f45c5993f3fcf5082807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:21Z,use_quota=True,user_id='8fd17db6ff2b473eafb309723edd6285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce993a9c-706c-49e6-b926-6f5b2184a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce993a9c-706c-49e6-b926-6f5b2184a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d89e4-5715-40af-8c77-9273bcdbadd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d89e4-5715-40af-8c77-9273bcdbadd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f305e6-b7c7-4047-8b57-41ee0536d06e', 'volume_name': 'volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3685a869-1ed3-41ae-ba94-745b2e89c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3685a869-1ed3-41ae-ba94-745b2e89c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952d856d-2606-437a-afab-4aa582234e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Volume c0f305e6-b7c7-4047-8b57-41ee0536d06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e', 'volume_size': 1} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.764s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372691114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8eaab67cf84f6da980ada21b3ceab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:18Z,use_quota=True,user_id='544cbfe30b854780bbf063392eec4d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Creating volume a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:20 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 2147483648 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 2147483648 Sep 28 18:22:20 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea0ac6-9392-499c-8aba-f84864f24448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0228153f-64c7-49c5-b950-646a8621f04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:20 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Volume volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f (74307b8e-48c5-4d67-ae20-cbff97e6f02f): created successfully Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0228153f-64c7-49c5-b950-646a8621f04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:20 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (3e7f42b0-e0d2-47f7-96c2-4405d5ef535b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:20 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-af83d7c4-7f00-4537-99aa-4e7a1b2104e0 tempest-AttachVolumeNegativeTest-1323152625 None] Created volume successfully. Sep 28 18:22:21 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 2147483648" returned: 0 in 0.573s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 Sep 28 18:22:21 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-320006267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f305e6-b7c7-4047-8b57-41ee0536d06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec492bdf73f45c5993f3fcf5082807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:21Z,use_quota=True,user_id='8fd17db6ff2b473eafb309723edd6285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Creating volume c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebfb503-f42c-498f-8334-f45e3478b9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8', 'volume_size': 2}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e 1073741824 Sep 28 18:22:21 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce0b9-fc68-4c65-863b-70a1fc829f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Volume volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 (a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8): created successfully Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce0b9-fc68-4c65-863b-70a1fc829f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Flow 'volume_create_manager' (7aaa0599-5a4f-4e5f-a0f6-3e5ca06fcaba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1321cb47-74c7-4bb3-b60f-7f92ff7dbb39 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Created volume successfully. Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (123584d9-12f4-4c6a-af17-fa020c7c74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1826f-37ee-4558-a78e-4c3d25e75c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1826f-37ee-4558-a78e-4c3d25e75c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181274516',display_name='tempest-VolumesGetTest-Volume-1636498071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725320e7-2621-4a30-b4a5-18de3bea51f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:22Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea670e4-a6b0-4533-8362-c92d90c10b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea670e4-a6b0-4533-8362-c92d90c10b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0e7c2e-043c-4d44-a200-4118f1d90d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0e7c2e-043c-4d44-a200-4118f1d90d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725320e7-2621-4a30-b4a5-18de3bea51f7', 'volume_name': 'volume-725320e7-2621-4a30-b4a5-18de3bea51f7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dff68-089a-41b2-aa7f-2416484afb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dff68-089a-41b2-aa7f-2416484afb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9336e51a-3abe-40d1-9344-4cd28837bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Volume 725320e7-2621-4a30-b4a5-18de3bea51f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725320e7-2621-4a30-b4a5-18de3bea51f7', 'volume_size': 1} Sep 28 18:22:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:22 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e 1073741824" returned: 0 in 0.644s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:22 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e Sep 28 18:22:22 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:22 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e" returned: 0 in 0.341s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181274516',display_name='tempest-VolumesGetTest-Volume-1636498071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725320e7-2621-4a30-b4a5-18de3bea51f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:22Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Creating volume 725320e7-2621-4a30-b4a5-18de3bea51f7 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:22 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952d856d-2606-437a-afab-4aa582234e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:22 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 1073741824 Sep 28 18:22:22 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c48281-ffc0-4a57-96cc-c654437e53b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Volume volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e (c0f305e6-b7c7-4047-8b57-41ee0536d06e): created successfully Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c48281-ffc0-4a57-96cc-c654437e53b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Flow 'volume_create_manager' (7eced237-9681-4846-8b70-dc71ab08de82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3ea0fd6d-6b59-4006-98bb-0aeb2418b375 tempest-SnapshotMetadataTestJSON-1945634575 None] Created volume successfully. Sep 28 18:22:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-76e11a4b-e583-4a84-947f-4357e2b4ea94 req-b4a61696-3d27-462a-8726-47df66d8acfe tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:23 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 1073741824" returned: 0 in 0.502s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:23 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 Sep 28 18:22:23 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:23 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.127s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9336e51a-3abe-40d1-9344-4cd28837bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725320e7-2621-4a30-b4a5-18de3bea51f7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19262d1a-b662-4358-b821-9627872605c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Creating offline snapshot 21e1da58-e15a-41e2-a71d-b0bc9bf304a4 of volume a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:23 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Volume volume-725320e7-2621-4a30-b4a5-18de3bea51f7 (725320e7-2621-4a30-b4a5-18de3bea51f7): created successfully Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19262d1a-b662-4358-b821-9627872605c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (123584d9-12f4-4c6a-af17-fa020c7c74c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[977cfaf6-095b-45ee-b269-de8ea4fe9e9d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:23 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-04c4b9f8-7db2-4717-8096-381234160877 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:22:23 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 Sep 28 18:22:23 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:24 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" returned: 0 in 0.513s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 2G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:24 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 2G Sep 28 18:22:24 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-725320e7-2621-4a30-b4a5-18de3bea51f7-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "cinder-725320e7-2621-4a30-b4a5-18de3bea51f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-725320e7-2621-4a30-b4a5-18de3bea51f7" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-725320e7-2621-4a30-b4a5-18de3bea51f7" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ed6d1-4c29-4e03-8ff0-48a3031a44f0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:24 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 Sep 28 18:22:24 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:24 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 2G" returned: 0 in 0.621s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:24 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 Sep 28 18:22:24 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:24 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:24 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7 Sep 28 18:22:24 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:25 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 is being set with open permissions: ugo+rw Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 Sep 28 18:22:25 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:25 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-725320e7-2621-4a30-b4a5-18de3bea51f7" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-725320e7-2621-4a30-b4a5-18de3bea51f7" released by "delete_volume" :: held 0.802s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Created reservations ['756ff327-9e88-44a8-b05d-c8c7840947e7', '49687fc5-e093-40fa-8dd1-732a0564db70', '32b86930-d099-4114-9c85-ddf9cd94c977', '14a8de1a-5c41-4f30-8ead-f6a8d2bbeb01'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:25 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info Sep 28 18:22:25 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:25 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:25 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-cf71ea39-088c-4bd6-a31c-b18459c2d1a0-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "cinder-cf71ea39-088c-4bd6-a31c-b18459c2d1a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:25 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.341s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:25 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:25 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info" returned: 0 in 0.386s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info is being set with open permissions: ugo+rw Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" acquired by "delete_volume" :: waited 0.044s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:25 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info Sep 28 18:22:25 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47295fbe-1db9-488b-84e7-3512d88e8dde tempest-VolumesGetTest-651685032 None] Lock "cinder-725320e7-2621-4a30-b4a5-18de3bea51f7-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14af1e-51b4-42d4-a9a7-7fcc05cd2aa4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 Sep 28 18:22:26 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.info" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-76e11a4b-e583-4a84-947f-4357e2b4ea94 req-b4a61696-3d27-462a-8726-47df66d8acfe tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.214s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-76e11a4b-e583-4a84-947f-4357e2b4ea94 req-b4a61696-3d27-462a-8726-47df66d8acfe tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.028s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-00094281-3218-40c9-8aeb-850dddeaaf2b tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Create snapshot completed successfully Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Creating offline snapshot 9fc374f0-ce1e-4e50-a247-be4f200fed52 of volume c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-76e11a4b-e583-4a84-947f-4357e2b4ea94 req-b4a61696-3d27-462a-8726-47df66d8acfe tempest-AttachVolumeNegativeTest-1323152625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25e6b5a9-7f7a-4dab-93a1-fd753ae4d6df', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e2e25-314e-4cfe-a55d-2724ca390952]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-76e11a4b-e583-4a84-947f-4357e2b4ea94 req-b4a61696-3d27-462a-8726-47df66d8acfe tempest-AttachVolumeNegativeTest-1323152625 None] attachment_update completed successfully. Sep 28 18:22:26 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e Sep 28 18:22:26 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" returned: 0 in 0.543s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0 Sep 28 18:22:26 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "cinder-21e1da58-e15a-41e2-a71d-b0bc9bf304a4-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-21e1da58-e15a-41e2-a71d-b0bc9bf304a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "cinder-quobyte-21e1da58-e15a-41e2-a71d-b0bc9bf304a4" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-21e1da58-e15a-41e2-a71d-b0bc9bf304a4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Deleting offline snapshot 21e1da58-e15a-41e2-a71d-b0bc9bf304a4 of volume a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:26 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] snapshot_file for this snap is: volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e" returned: 0 in 0.674s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc37470-af2b-47ba-9a35-2cc16fe281a4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 1G Sep 28 18:22:26 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" returned: 0 in 0.540s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-cf71ea39-088c-4bd6-a31c-b18459c2d1a0" released by "delete_volume" :: held 1.170s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Created reservations ['521827bc-68bf-4a0e-a992-74b186d706fa', 'ee26d2ed-8024-4194-ad1c-0cfae9a51f05', '7dc36d2a-87ce-4ba0-b1f4-a491d6315187', 'bdb22c9d-84d7-486e-bb64-670b828d66aa'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:27 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 Sep 28 18:22:27 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:27 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:27 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:27 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4" returned: 0 in 0.581s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:27 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.356s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:27 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9496c134-72d0-4db2-a75c-48ffbfb5e2c2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 1G" returned: 0 in 0.671s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:27 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 Sep 28 18:22:27 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:27 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0bebce63-5894-49c9-a5ae-c7e476cf9076 tempest-VolumesGetTest-651685032 None] Lock "cinder-cf71ea39-088c-4bd6-a31c-b18459c2d1a0-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:27 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 Sep 28 18:22:27 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 is being set with open permissions: ugo+rw Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 Sep 28 18:22:28 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" returned: 0 in 0.513s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 Sep 28 18:22:28 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-7c72312e-da67-42dc-a8c0-85853be1c065-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "cinder-7c72312e-da67-42dc-a8c0-85853be1c065-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-7c72312e-da67-42dc-a8c0-85853be1c065" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-7c72312e-da67-42dc-a8c0-85853be1c065" acquired by "delete_volume" :: waited 0.049s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f1051-ba81-4cd3-abb4-079dea88cfe9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52" returned: 0 in 0.389s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info Sep 28 18:22:28 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:28 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4" returned: 0 in 0.555s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4 Sep 28 18:22:28 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info is being set with open permissions: ugo+rw Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info Sep 28 18:22:28 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.592s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065 Sep 28 18:22:29 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8.21e1da58-e15a-41e2-a71d-b0bc9bf304a4" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-21e1da58-e15a-41e2-a71d-b0bc9bf304a4" released by "_delete_snapshot" :: held 2.268s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" released by "delete_snapshot" :: held 2.307s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:29 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.info" returned: 0 in 0.356s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-46ed00eb-21da-4849-8b32-9db2b64fe3d2 tempest-SnapshotMetadataTestJSON-1945634575 None] Create snapshot completed successfully Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Created reservations ['7c568ccb-1ba4-4f69-bf71-4c4e698bcedb', 'a1bc9f9e-f76c-4686-80f1-1098a92fa3e4', 'e64046bb-bb05-4961-9236-86dffd6b1b80', 'f070b20c-ff2b-4058-a830-5ec10130636f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:29 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7c72312e-da67-42dc-a8c0-85853be1c065" returned: 0 in 0.368s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-7c72312e-da67-42dc-a8c0-85853be1c065" released by "delete_volume" :: held 1.097s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Delete snapshot completed successfully. Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a3589c0c-799b-4440-849c-941f6b11e290 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-21e1da58-e15a-41e2-a71d-b0bc9bf304a4-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Created reservations ['f2421cf3-fb53-481d-b85f-9438b3f92912', '43420759-72c5-4742-86ef-83eec7314a79', '10db51aa-85a1-4070-b3ad-5e732f1fbdb9', '7f901a33-fcc2-4a0d-8bef-1a558263a54d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:29 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0378353d-a2b9-44ba-830f-adbc08da45cb tempest-VolumesGetTest-651685032 None] Lock "cinder-7c72312e-da67-42dc-a8c0-85853be1c065-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "cinder-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b0eae9-f487-4eec-90e4-2417a8c8cc0e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:30 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 Sep 28 18:22:30 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "cinder-9fc374f0-ce1e-4e50-a247-be4f200fed52-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-9fc374f0-ce1e-4e50-a247-be4f200fed52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "cinder-quobyte-9fc374f0-ce1e-4e50-a247-be4f200fed52" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-9fc374f0-ce1e-4e50-a247-be4f200fed52" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Deleting offline snapshot 9fc374f0-ce1e-4e50-a247-be4f200fed52 of volume c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] snapshot_file for this snap is: volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f004af81-0cd5-4387-804e-a92c2ee30cf4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:30 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 Sep 28 18:22:30 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:30 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" returned: 0 in 0.500s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:30 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8 Sep 28 18:22:30 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:31 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52" returned: 0 in 0.510s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:31 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[618dde6f-aafc-4d22-902a-86a449069728]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-quobyte-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8" released by "delete_volume" :: held 0.931s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Created reservations ['dbbf9979-0a9c-4ecd-9af6-c691137ca9fb', 'f702a55c-7e71-4ac6-8be7-e6301bc1d600', 'be6038c7-7ce6-4d4d-9ffc-ed6c3342c2c1', '9c1a2508-94da-4443-8d03-6e0b7c8851cb'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:31 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e Sep 28 18:22:31 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:31 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:31 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (d2ef37ab-4ada-4e79-9867-74ef93339516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0ffe96-1945-4760-8b05-759e3c107a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0ffe96-1945-4760-8b05-759e3c107a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648201677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c6f292-f4d6-4663-8eb6-c034647c0933,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:32Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94eb407-a6d1-4a56-8694-b655430d9cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94eb407-a6d1-4a56-8694-b655430d9cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326ed22c-f59f-4925-b0de-fe2eec75545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e" returned: 0 in 0.665s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:31 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Deleted volume successfully. Sep 28 18:22:31 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 Sep 28 18:22:31 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e98be9a8-693d-41a0-bcd4-ca335f422172 tempest-VolumesSnapshotNegativeTestJSON-541196446 None] Lock "cinder-a1d5421c-5c6a-4ca5-bf8b-407e2c183ff8-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326ed22c-f59f-4925-b0de-fe2eec75545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73c6f292-f4d6-4663-8eb6-c034647c0933', 'volume_name': 'volume-73c6f292-f4d6-4663-8eb6-c034647c0933', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aea669-17f2-4bdc-a92f-02bb013e90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aea669-17f2-4bdc-a92f-02bb013e90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7b2f8f-c94c-4b0a-a4ce-94eadd351d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:32 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Volume 73c6f292-f4d6-4663-8eb6-c034647c0933: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73c6f292-f4d6-4663-8eb6-c034647c0933', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Trying to clone 73c6f292-f4d6-4663-8eb6-c034647c0933 from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:22:32 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52" returned: 0 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52 Sep 28 18:22:32 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:22:32 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:22:32 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e.9fc374f0-ce1e-4e50-a247-be4f200fed52" returned: 0 in 0.507s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[879a8eea-ef96-4ced-b011-504797648652]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-9fc374f0-ce1e-4e50-a247-be4f200fed52" released by "_delete_snapshot" :: held 2.391s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" released by "delete_snapshot" :: held 2.430s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Created reservations ['75d98705-a7cd-4010-b88e-15d5c8b900b8', '64c338b9-678c-4cfa-be58-3a1c47fdfea2', 'aca702ca-4d78-4083-956e-ddf74d235cae', '0b54a989-2a9f-4d84-ad23-ecd6e6e20018'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:33 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD Sep 28 18:22:33 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Delete snapshot completed successfully. Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7c0d0085-f0ec-442b-be0b-ac5401ee9c3c tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-9fc374f0-ce1e-4e50-a247-be4f200fed52-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:33 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 is fetched for user 8e44df90cd22449ab76f3079e87d3f79. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0813afa0-825b-4ed0-a90a-28d88cd3ce6e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:33 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD Sep 28 18:22:33 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "cinder-c0f305e6-b7c7-4047-8b57-41ee0536d06e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-c0f305e6-b7c7-4047-8b57-41ee0536d06e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=120,cinder:UPDATE=142,cinder:INSERT=41,cinder:DELETE=17 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:33 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD" returned: 0 in 0.585s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648201677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c6f292-f4d6-4663-8eb6-c034647c0933,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:32Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Creating volume 73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:34 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[68305621-c1aa-4ea6-9174-3b843607639f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1073741824 Sep 28 18:22:34 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:34 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e Sep 28 18:22:34 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:34 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e" returned: 0 in 0.593s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e Sep 28 18:22:34 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:34 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1073741824" returned: 0 in 0.868s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 Sep 28 18:22:35 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:35 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c0f305e6-b7c7-4047-8b57-41ee0536d06e" returned: 0 in 0.547s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-quobyte-c0f305e6-b7c7-4047-8b57-41ee0536d06e" released by "delete_volume" :: held 1.306s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Created reservations ['55686b0a-91a8-4aeb-89bb-4c9dac803806', '7a10fda1-4189-4844-b0d3-94c32bb16783', '8f46cacd-e295-41c5-ac52-54b8ec051206', 'a26db887-6915-4d0a-8c9c-519804b68b30'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:35 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933" returned: 0 in 0.492s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Attempting download of 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 73c6f292-f4d6-4663-8eb6-c034647c0933. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:35 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95b70a-a03c-4e35-98b0-00af5f152892]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j Sep 28 18:22:35 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.450s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Deleted volume successfully. Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9e93e8b3-cb3a-4ee4-94b5-ed954401de55 tempest-SnapshotMetadataTestJSON-1945634575 None] Lock "cinder-c0f305e6-b7c7-4047-8b57-41ee0536d06e-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:36 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j" returned: 0 in 0.662s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j Sep 28 18:22:36 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j" returned: 1 in 0.468s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_pgyepc7j' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[647d86e8-8c59-4517-927a-2368fc2ce6c4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:37 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD Sep 28 18:22:37 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:37 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:37 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:22:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:37 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 Sep 28 18:22:37 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:40 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933" returned: 0 in 3.207s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:40 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_etagizdrdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:40 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Converted 112.00 MB image at 34.89 MB/s Sep 28 18:22:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:40 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1G Sep 28 18:22:40 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 1G" returned: 0 in 0.765s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Downloaded image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume 73c6f292-f4d6-4663-8eb6-c034647c0933 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 for user 8e44df90cd22449ab76f3079e87d3f79 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Marking volume 73c6f292-f4d6-4663-8eb6-c034647c0933 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Copying metadata from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 to 73c6f292-f4d6-4663-8eb6-c034647c0933. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Creating volume glance metadata for volume 73c6f292-f4d6-4663-8eb6-c034647c0933 backed by image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7b2f8f-c94c-4b0a-a4ce-94eadd351d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c6f292-f4d6-4663-8eb6-c034647c0933', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e2cd9b-b2d3-4c86-a749-55f8d00a796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Volume volume-73c6f292-f4d6-4663-8eb6-c034647c0933 (73c6f292-f4d6-4663-8eb6-c034647c0933): created successfully Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e2cd9b-b2d3-4c86-a749-55f8d00a796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (d2ef37ab-4ada-4e79-9867-74ef93339516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-caec5e58-4215-4580-8aa2-5b316c2142b6 tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (19539603-ff77-41d6-91f1-f5be23289127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8476e4-7fd8-4ebe-ae64-1446c1ee2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8476e4-7fd8-4ebe-ae64-1446c1ee2847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686004933',display_name='tempest-VolumesGetTest-Volume-198860650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3468f9-aee8-4652-bd7d-d0f5376a2ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:44Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1b490-fb58-4f25-acb3-c0b203694db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1b490-fb58-4f25-acb3-c0b203694db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c957ce-e3ec-460b-a15b-dba57aac270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c957ce-e3ec-460b-a15b-dba57aac270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3468f9-aee8-4652-bd7d-d0f5376a2ec5', 'volume_name': 'volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0772116-5a92-49dd-8cd9-b19b73882b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0772116-5a92-49dd-8cd9-b19b73882b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44cc925-8175-4266-9b37-ee5f5e44a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Volume 3c3468f9-aee8-4652-bd7d-d0f5376a2ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5', 'volume_size': 1} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686004933',display_name='tempest-VolumesGetTest-Volume-198860650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3468f9-aee8-4652-bd7d-d0f5376a2ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f18dc5f6d3a44b98506fbc4b677159c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:44Z,use_quota=True,user_id='8e44df90cd22449ab76f3079e87d3f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Creating volume 3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:44 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 1073741824 Sep 28 18:22:44 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 1073741824" returned: 0 in 0.929s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:45 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 Sep 28 18:22:45 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:46 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" returned: 0 in 0.472s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=117,cinder:UPDATE=153,cinder:DELETE=8,cinder:INSERT=39 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44cc925-8175-4266-9b37-ee5f5e44a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220af784-9368-4861-b115-21705ede720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Volume volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 (3c3468f9-aee8-4652-bd7d-d0f5376a2ec5): created successfully Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220af784-9368-4861-b115-21705ede720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Flow 'volume_create_manager' (19539603-ff77-41d6-91f1-f5be23289127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-efdb5445-d714-4f1d-9e0b-0c7944b933cb tempest-VolumesGetTest-651685032 None] Created volume successfully. Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "cinder-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" acquired by "delete_volume" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75730a-4bf9-4204-bb22-a3917f226af7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:47 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 Sep 28 18:22:47 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Flow 'volume_create_manager' (9dd859d5-833f-4592-8075-ba6444350073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a194c463-38f8-408a-8194-c6f5a2f623bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a194c463-38f8-408a-8194-c6f5a2f623bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1818709570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0a7b3e-1339-47b3-9354-4a4e40139538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e503c72a6904abebdd1fe5136dd81d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:47Z,use_quota=True,user_id='90fd70bbee044965b36a15e7a1a0f697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3990fae8-072b-4cac-8a57-dc6e25bfc4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3990fae8-072b-4cac-8a57-dc6e25bfc4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89328c1a-908c-4920-b2af-69e11b2009ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89328c1a-908c-4920-b2af-69e11b2009ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0a7b3e-1339-47b3-9354-4a4e40139538', 'volume_name': 'volume-7e0a7b3e-1339-47b3-9354-4a4e40139538', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a01500-d79c-49ec-a6de-328c953a858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a01500-d79c-49ec-a6de-328c953a858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384561a-fd3b-45fa-a577-017aaeea3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Volume 7e0a7b3e-1339-47b3-9354-4a4e40139538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0a7b3e-1339-47b3-9354-4a4e40139538', 'volume_size': 1} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1818709570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0a7b3e-1339-47b3-9354-4a4e40139538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e503c72a6904abebdd1fe5136dd81d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:47Z,use_quota=True,user_id='90fd70bbee044965b36a15e7a1a0f697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Creating volume 7e0a7b3e-1339-47b3-9354-4a4e40139538 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:47 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:47 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 1073741824 Sep 28 18:22:47 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:47 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" returned: 0 in 0.671s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:47 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5 Sep 28 18:22:47 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:48 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" returned: 0 in 0.501s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5" released by "delete_volume" :: held 1.267s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:48 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 1073741824" returned: 0 in 0.748s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Created reservations ['0e453ed7-506a-4434-8d02-7fafa59fdfb8', '3b290241-4db8-442e-aa36-ff635aea11e9', '0f03efd8-eb0d-482e-95e5-2a6380cabc4f', 'b3296951-3746-473b-a778-c6b7b4d3c585'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:48 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 Sep 28 18:22:48 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:48 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:48 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:49 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538" returned: 0 in 0.719s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384561a-fd3b-45fa-a577-017aaeea3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0a7b3e-1339-47b3-9354-4a4e40139538', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4789b4-3437-4615-abd0-705413439d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:49 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.665s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Volume volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 (7e0a7b3e-1339-47b3-9354-4a4e40139538): created successfully Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4789b4-3437-4615-abd0-705413439d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Flow 'volume_create_manager' (9dd859d5-833f-4592-8075-ba6444350073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e217522b-3ed9-42bd-89b7-ac214ea30c19 tempest-VolumesTransfersV355Test-1561797940 None] Created volume successfully. Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-cb56bc05-f634-454c-b137-0f3c6c587876 tempest-VolumesGetTest-651685032 None] Lock "cinder-3c3468f9-aee8-4652-bd7d-d0f5376a2ec5-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-73c6f292-f4d6-4663-8eb6-c034647c0933-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "cinder-73c6f292-f4d6-4663-8eb6-c034647c0933-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Acquiring lock "cinder-quobyte-73c6f292-f4d6-4663-8eb6-c034647c0933" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-73c6f292-f4d6-4663-8eb6-c034647c0933" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[16660999-86fd-4a8a-beb0-cbf31f3f1b10]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:49 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 Sep 28 18:22:49 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:50 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933" returned: 0 in 0.469s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:50 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933 Sep 28 18:22:50 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d40aa379-a9c0-4c27-af78-cbd111e475fd tempest-VolumesTransfersV355Test-125693785 None] Transfer volume completed successfully. Sep 28 18:22:50 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-73c6f292-f4d6-4663-8eb6-c034647c0933" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "cinder-quobyte-73c6f292-f4d6-4663-8eb6-c034647c0933" released by "delete_volume" :: held 0.903s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Created reservations ['f2d9335d-35ca-4a85-b069-5e1804e1ad86', '84c7eb3c-e35b-4d90-81a6-b4b718ab9e0e', '8f2b17ed-0988-430f-b1a1-e5efdc57c384', 'ff157eb3-f28e-40dc-85f7-ea51f1c9645a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:51 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:51 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:51 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.593s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Deleted volume successfully. Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2037b283-6ac9-4472-87b3-421375043d04 tempest-VolumesGetTest-651685032 None] Lock "cinder-73c6f292-f4d6-4663-8eb6-c034647c0933-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "cinder-7e0a7b3e-1339-47b3-9354-4a4e40139538-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-7e0a7b3e-1339-47b3-9354-4a4e40139538-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "cinder-quobyte-7e0a7b3e-1339-47b3-9354-4a4e40139538" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-quobyte-7e0a7b3e-1339-47b3-9354-4a4e40139538" acquired by "delete_volume" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a13bf9-b47f-4875-bfc8-4750ffa80683]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:52 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 Sep 28 18:22:52 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:52 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538" returned: 0 in 0.653s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:52 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538 Sep 28 18:22:52 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e0a7b3e-1339-47b3-9354-4a4e40139538" returned: 0 in 0.582s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-quobyte-7e0a7b3e-1339-47b3-9354-4a4e40139538" released by "delete_volume" :: held 1.374s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Created reservations ['ce030224-9966-4f24-a355-6f5147330a20', 'bded3072-3f15-4fb3-91c3-16b9574f0ebe', '1eae5f42-aeae-42e2-809c-6e76bb6ab321', 'bb8f57ce-d489-4289-91e4-a1475cb02392'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:53 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:22:53 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.358s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Deleted volume successfully. Sep 28 18:22:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836cf69c-9886-492a-878a-058c496d3416 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-7e0a7b3e-1339-47b3-9354-4a4e40139538-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Flow 'volume_create_manager' (8cddf0e6-298e-4e7d-8c3c-5231b94fee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b429b20-83c7-4716-8683-e92342f012d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b429b20-83c7-4716-8683-e92342f012d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-162347304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161cee71-460b-49d7-9741-204811ac7fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e503c72a6904abebdd1fe5136dd81d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:55Z,use_quota=True,user_id='90fd70bbee044965b36a15e7a1a0f697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a23ed-9a16-40ab-a19a-f481d14a1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a23ed-9a16-40ab-a19a-f481d14a1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5f6632-45de-4fb9-99d6-4c5d4225ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5f6632-45de-4fb9-99d6-4c5d4225ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161cee71-460b-49d7-9741-204811ac7fc0', 'volume_name': 'volume-161cee71-460b-49d7-9741-204811ac7fc0', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b7eac-f1fc-4480-bdd5-8b4e2fbc04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b7eac-f1fc-4480-bdd5-8b4e2fbc04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c928f9-eb3e-4d71-bcb7-a5c42f3e6522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Volume 161cee71-460b-49d7-9741-204811ac7fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161cee71-460b-49d7-9741-204811ac7fc0', 'volume_size': 1} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-162347304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161cee71-460b-49d7-9741-204811ac7fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e503c72a6904abebdd1fe5136dd81d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:55Z,use_quota=True,user_id='90fd70bbee044965b36a15e7a1a0f697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Creating volume 161cee71-460b-49d7-9741-204811ac7fc0 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:55 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 1073741824 Sep 28 18:22:55 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:56 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 1073741824" returned: 0 in 1.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 Sep 28 18:22:56 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:57 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0" returned: 0 in 0.488s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c928f9-eb3e-4d71-bcb7-a5c42f3e6522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161cee71-460b-49d7-9741-204811ac7fc0', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db25218c-21b0-44ca-b16b-0575cc7f184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Volume volume-161cee71-460b-49d7-9741-204811ac7fc0 (161cee71-460b-49d7-9741-204811ac7fc0): created successfully Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db25218c-21b0-44ca-b16b-0575cc7f184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Flow 'volume_create_manager' (8cddf0e6-298e-4e7d-8c3c-5231b94fee1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3b3ba875-8191-4abb-a2d5-4d8a8d8553e4 tempest-VolumesTransfersV355Test-1561797940 None] Created volume successfully. Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "cinder-161cee71-460b-49d7-9741-204811ac7fc0-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-161cee71-460b-49d7-9741-204811ac7fc0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "cinder-quobyte-161cee71-460b-49d7-9741-204811ac7fc0" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-quobyte-161cee71-460b-49d7-9741-204811ac7fc0" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e1f8e-0a9a-4b72-87a2-c768af2a9c5f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 Sep 28 18:22:59 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (c2007f20-8709-40b1-917b-c0011c00d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314d0fd-d42d-4ca5-a245-2d95a7ac5a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314d0fd-d42d-4ca5-a245-2d95a7ac5a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-319598510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7053f3-0228-42f6-bb49-b1c265034048,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:59Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2300636d-4b38-4d0f-b2f0-dcce54d93b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2300636d-4b38-4d0f-b2f0-dcce54d93b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd7bb8d-519b-4df8-a955-2c162491d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd7bb8d-519b-4df8-a955-2c162491d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7053f3-0228-42f6-bb49-b1c265034048', 'volume_name': 'volume-1f7053f3-0228-42f6-bb49-b1c265034048', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:59 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72fb1e-9401-459b-975f-09baf6cc8a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72fb1e-9401-459b-975f-09baf6cc8a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7f2e34-0cb2-4914-baef-6a8cba33100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:59 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Volume 1f7053f3-0228-42f6-bb49-b1c265034048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7053f3-0228-42f6-bb49-b1c265034048', 'volume_size': 1} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-319598510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7053f3-0228-42f6-bb49-b1c265034048,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:59Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Creating volume 1f7053f3-0228-42f6-bb49-b1c265034048 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:59 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0" returned: 0 in 0.525s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 1073741824 Sep 28 18:22:59 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0 Sep 28 18:22:59 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-161cee71-460b-49d7-9741-204811ac7fc0" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-quobyte-161cee71-460b-49d7-9741-204811ac7fc0" released by "delete_volume" :: held 0.962s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Created reservations ['91ad9d7c-9c81-470f-8fa4-49dfc80f1951', '763f2856-7b10-43c3-a4c5-fed037a584c4', '5c528e13-153f-4fd9-a4d5-c90edec3013e', 'ad77bfdf-886b-42e9-881f-3c25e0269d66'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:00 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:23:00 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:00 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 1073741824" returned: 0 in 0.680s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:00 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:23:00 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:00 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 Sep 28 18:23:00 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:00 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Deleted volume successfully. Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c67188d2-d09a-433a-8d4e-98147fa19277 tempest-VolumesTransfersV355Test-1722970151 None] Lock "cinder-161cee71-460b-49d7-9741-204811ac7fc0-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:00 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.368s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:23:00 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048" returned: 0 in 0.323s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7f2e34-0cb2-4914-baef-6a8cba33100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7053f3-0228-42f6-bb49-b1c265034048', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caf303b-e549-4616-a49f-81ff9308c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:00 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Volume volume-1f7053f3-0228-42f6-bb49-b1c265034048 (1f7053f3-0228-42f6-bb49-b1c265034048): created successfully Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caf303b-e549-4616-a49f-81ff9308c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (c2007f20-8709-40b1-917b-c0011c00d971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3795e79e-0ff1-425c-8c7e-93fe0a5ebb15 tempest-VolumesListTestJSON-361580718 None] Created volume successfully. Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (d4676c8b-c814-4182-8375-84e59071a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cf338d-4642-4739-b4bf-b82b5132b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cf338d-4642-4739-b4bf-b82b5132b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632691545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2614836-172e-4f44-a210-2069b6e43290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:02Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b0c5d-21b9-4a1d-9ac3-2473f6f25d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b0c5d-21b9-4a1d-9ac3-2473f6f25d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb360293-56d1-4032-aa8b-3c55041a5397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb360293-56d1-4032-aa8b-3c55041a5397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2614836-172e-4f44-a210-2069b6e43290', 'volume_name': 'volume-f2614836-172e-4f44-a210-2069b6e43290', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beedad9-0d38-4a1d-9a5c-1cbcb8586a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beedad9-0d38-4a1d-9a5c-1cbcb8586a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15210e0f-e19d-4866-afe9-aa55d4f4ef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Volume f2614836-172e-4f44-a210-2069b6e43290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2614836-172e-4f44-a210-2069b6e43290', 'volume_size': 1} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632691545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2614836-172e-4f44-a210-2069b6e43290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:02Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Creating volume f2614836-172e-4f44-a210-2069b6e43290 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:02 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:02 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 1073741824 Sep 28 18:23:02 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:02 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 1073741824" returned: 0 in 0.611s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:02 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 Sep 28 18:23:02 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:03 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15210e0f-e19d-4866-afe9-aa55d4f4ef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2614836-172e-4f44-a210-2069b6e43290', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5242f-f288-482e-a3f0-a0175b088661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Volume volume-f2614836-172e-4f44-a210-2069b6e43290 (f2614836-172e-4f44-a210-2069b6e43290): created successfully Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5242f-f288-482e-a3f0-a0175b088661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (d4676c8b-c814-4182-8375-84e59071a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-970abeec-4041-47b3-8583-36c3bf075f32 tempest-VolumesListTestJSON-361580718 None] Created volume successfully. Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (76317c51-fd62-43e9-bfd1-1b86ce73417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da26a4de-ce26-42ea-bfbd-0f7cbc37a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da26a4de-ce26-42ea-bfbd-0f7cbc37a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1878415872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360fe7ed-b349-4806-822b-6adda76f636e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:05Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9afd85-2565-4c8b-9599-308df8690fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9afd85-2565-4c8b-9599-308df8690fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da64ed2-af78-4656-a8d3-270339b3c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da64ed2-af78-4656-a8d3-270339b3c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360fe7ed-b349-4806-822b-6adda76f636e', 'volume_name': 'volume-360fe7ed-b349-4806-822b-6adda76f636e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c275959-9e39-4a52-863d-1b4945f328dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c275959-9e39-4a52-863d-1b4945f328dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aad815d-1f65-4190-a940-c8a5af5fd766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Volume 360fe7ed-b349-4806-822b-6adda76f636e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360fe7ed-b349-4806-822b-6adda76f636e', 'volume_size': 1} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1878415872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360fe7ed-b349-4806-822b-6adda76f636e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76fe31de939340edb1c03ca9376c5497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:05Z,use_quota=True,user_id='8a9510e544ff41438267c526a9fc9809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Creating volume 360fe7ed-b349-4806-822b-6adda76f636e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:05 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:05 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e 1073741824 Sep 28 18:23:05 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:05 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e 1073741824" returned: 0 in 0.670s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:05 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e Sep 28 18:23:05 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:06 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e" returned: 0 in 0.445s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aad815d-1f65-4190-a940-c8a5af5fd766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360fe7ed-b349-4806-822b-6adda76f636e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d818f4a6-3e58-4774-8381-c85162e1bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Volume volume-360fe7ed-b349-4806-822b-6adda76f636e (360fe7ed-b349-4806-822b-6adda76f636e): created successfully Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d818f4a6-3e58-4774-8381-c85162e1bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Flow 'volume_create_manager' (76317c51-fd62-43e9-bfd1-1b86ce73417c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-78dce201-7670-450e-b173-78d2a80ab2fe tempest-VolumesListTestJSON-361580718 None] Created volume successfully. Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-360fe7ed-b349-4806-822b-6adda76f636e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-360fe7ed-b349-4806-822b-6adda76f636e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-quobyte-360fe7ed-b349-4806-822b-6adda76f636e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-360fe7ed-b349-4806-822b-6adda76f636e" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0981a305-2436-457e-a922-b855ffeafb25]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e Sep 28 18:23:11 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e" returned: 0 in 0.646s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:12 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e Sep 28 18:23:12 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:12 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-360fe7ed-b349-4806-822b-6adda76f636e" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-360fe7ed-b349-4806-822b-6adda76f636e" released by "delete_volume" :: held 1.082s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Created reservations ['939c7801-201e-458c-b0c5-5769d2e6f6b4', '75eef573-6604-411a-bd8b-1c4db78b98f3', '383a1210-df86-4da0-925a-1f823b35196c', 'f588cd97-3c2a-46ba-ab73-da4a94b282a1'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:12 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:23:12 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:12 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.484s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Deleted volume successfully. Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-78cbda27-f285-4563-b55f-1583ac919025 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-360fe7ed-b349-4806-822b-6adda76f636e-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-f2614836-172e-4f44-a210-2069b6e43290-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-f2614836-172e-4f44-a210-2069b6e43290-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-quobyte-f2614836-172e-4f44-a210-2069b6e43290" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-f2614836-172e-4f44-a210-2069b6e43290" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[49024b31-766c-41e3-bc73-99be99880787]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:13 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 Sep 28 18:23:13 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:14 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290" returned: 0 in 0.531s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:14 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290 Sep 28 18:23:14 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:14 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f2614836-172e-4f44-a210-2069b6e43290" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-f2614836-172e-4f44-a210-2069b6e43290" released by "delete_volume" :: held 0.907s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Created reservations ['9d1c077e-b579-4345-9fa6-618f59e68cd7', 'a5a4c15b-9c9a-40f1-820e-28f19c76cd75', '43cd1c2d-d948-4a08-9f9f-0694957c92a8', 'e3e6bfb7-1eca-40ba-9f80-da7109d670a0'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:14 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:23:14 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-1283a1a4-9453-4c27-b594-b7f3016f44c0 req-2f35c9df-a07d-4a29-a0a1-ef41aefc83f5 tempest-AttachVolumeNegativeTest-1323152625 None] Terminate volume connection completed successfully. Sep 28 18:23:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-1283a1a4-9453-4c27-b594-b7f3016f44c0 req-2f35c9df-a07d-4a29-a0a1-ef41aefc83f5 tempest-AttachVolumeNegativeTest-1323152625 None] Deleting attachment 25e6b5a9-7f7a-4dab-93a1-fd753ae4d6df. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:23:15 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:15 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Deleted volume successfully. Sep 28 18:23:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-055e8e9a-c6ab-4100-9bea-0474e8a81c28 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-f2614836-172e-4f44-a210-2069b6e43290-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-1f7053f3-0228-42f6-bb49-b1c265034048-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-1f7053f3-0228-42f6-bb49-b1c265034048-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "cinder-quobyte-1f7053f3-0228-42f6-bb49-b1c265034048" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-1f7053f3-0228-42f6-bb49-b1c265034048" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9604111-d029-48b1-8516-6851d6611c0e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:16 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 Sep 28 18:23:16 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:16 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048" returned: 0 in 0.644s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:16 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048 Sep 28 18:23:16 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:17 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1f7053f3-0228-42f6-bb49-b1c265034048" returned: 0 in 0.325s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-quobyte-1f7053f3-0228-42f6-bb49-b1c265034048" released by "delete_volume" :: held 1.062s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Created reservations ['e51d8f71-99bc-4348-8e6f-dad0cb44c18d', '236b3769-6fd7-494b-b9af-67abbe4c3e96', '1ff0b3ac-0bf6-40be-8fb1-c337a37f8869', '557ef1d2-b8b6-49e4-a497-0876ceadf605'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:23:17 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:17 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Deleted volume successfully. Sep 28 18:23:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e6755a00-a5ae-49c2-9a8e-df4efcf46962 tempest-VolumesListTestJSON-361580718 None] Lock "cinder-1f7053f3-0228-42f6-bb49-b1c265034048-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Flow 'volume_create_manager' (10ebb94b-e4ef-4d74-a4f3-48e0174c9039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bb5911-4e09-44db-a7ac-b7b78ea7317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bb5911-4e09-44db-a7ac-b7b78ea7317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1033068858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eddff5-79e1-450d-b53f-768a2e40f58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abff03cce1aa426eb574254e1227f19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:25Z,use_quota=True,user_id='1fc0d09d44474786b091e95a77744814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8bc0e3-4fa2-4b5d-98b7-620ea65527fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8bc0e3-4fa2-4b5d-98b7-620ea65527fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684b0f49-aad6-40a5-be73-a1065fe9da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684b0f49-aad6-40a5-be73-a1065fe9da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10eddff5-79e1-450d-b53f-768a2e40f58c', 'volume_name': 'volume-10eddff5-79e1-450d-b53f-768a2e40f58c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1463e9ae-26b7-47c2-a1da-0252f00703f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1463e9ae-26b7-47c2-a1da-0252f00703f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bdf2b2-38fe-46e0-9e95-2a947fb039b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:24 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Volume 10eddff5-79e1-450d-b53f-768a2e40f58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10eddff5-79e1-450d-b53f-768a2e40f58c', 'volume_size': 1} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1033068858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eddff5-79e1-450d-b53f-768a2e40f58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abff03cce1aa426eb574254e1227f19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:25Z,use_quota=True,user_id='1fc0d09d44474786b091e95a77744814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Creating volume 10eddff5-79e1-450d-b53f-768a2e40f58c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:24 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:23:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c 1073741824 Sep 28 18:23:24 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:25 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c 1073741824" returned: 0 in 0.637s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:25 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c Sep 28 18:23:25 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:26 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c" returned: 0 in 0.360s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bdf2b2-38fe-46e0-9e95-2a947fb039b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10eddff5-79e1-450d-b53f-768a2e40f58c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4a0fe-c68c-4728-a821-667b3dd9b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Volume volume-10eddff5-79e1-450d-b53f-768a2e40f58c (10eddff5-79e1-450d-b53f-768a2e40f58c): created successfully Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4a0fe-c68c-4728-a821-667b3dd9b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Flow 'volume_create_manager' (10ebb94b-e4ef-4d74-a4f3-48e0174c9039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-99844e5a-5f00-48f6-867e-d5c5725d525c tempest-VolumesNegativeTest-118645681 None] Created volume successfully. Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Flow 'volume_create_manager' (f231966d-e0d5-47ad-bdc0-e4d40afcd680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20c4e3c-8bc2-410e-9b86-50acc14ae72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20c4e3c-8bc2-410e-9b86-50acc14ae72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-314454705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5fb258-85ae-4095-b595-e74a9f0af644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1400881e8a2444acba28902ef70fbe99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:27Z,use_quota=True,user_id='77e7f4cab7254d3f808f9568ba0cc741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ddc884-1571-4684-b035-605eeebfe0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ddc884-1571-4684-b035-605eeebfe0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e460a37-aab4-4a14-8d29-aa286184a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e460a37-aab4-4a14-8d29-aa286184a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5fb258-85ae-4095-b595-e74a9f0af644', 'volume_name': 'volume-cc5fb258-85ae-4095-b595-e74a9f0af644', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9381b8-f567-4c1f-be1b-095d8a4a6038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9381b8-f567-4c1f-be1b-095d8a4a6038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4063c22-451e-4705-b2c2-a046e65fccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Volume cc5fb258-85ae-4095-b595-e74a9f0af644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5fb258-85ae-4095-b595-e74a9f0af644', 'volume_size': 1} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-314454705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5fb258-85ae-4095-b595-e74a9f0af644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1400881e8a2444acba28902ef70fbe99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:27Z,use_quota=True,user_id='77e7f4cab7254d3f808f9568ba0cc741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Creating volume cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:27 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:23:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:27 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 1073741824 Sep 28 18:23:27 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:28 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 1073741824" returned: 0 in 1.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:28 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:23:28 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:28 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.527s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4063c22-451e-4705-b2c2-a046e65fccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5fb258-85ae-4095-b595-e74a9f0af644', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e9adf4-d059-4792-967f-59efc6cc0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Volume volume-cc5fb258-85ae-4095-b595-e74a9f0af644 (cc5fb258-85ae-4095-b595-e74a9f0af644): created successfully Sep 28 18:23:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e9adf4-d059-4792-967f-59efc6cc0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Flow 'volume_create_manager' (f231966d-e0d5-47ad-bdc0-e4d40afcd680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c79bc107-9306-41b7-ba5d-7092b3d09dbf tempest-VolumesActionsTest-880544991 None] Created volume successfully. Sep 28 18:23:39 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:DELETE=6,cinder:SELECT=55,cinder:UPDATE=82,cinder:INSERT=20 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=62,cinder:INSERT=24,cinder:UPDATE=88,cinder:DELETE=10 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Flow 'volume_create_manager' (57d01ed8-5db5-4a5f-944e-2d948ddbd3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3555e0-421a-45f0-aef0-5c6a92c682e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3555e0-421a-45f0-aef0-5c6a92c682e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1802905152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93346598-92d3-424e-b70c-e204b0c66870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e35d326be8f40678175839dda2c6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:43Z,use_quota=True,user_id='1c8ab8e394b642a2becb21c2aae66b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483bd878-394b-4a0b-b667-f33a09a3c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483bd878-394b-4a0b-b667-f33a09a3c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac05362-cf90-4c8a-aa49-a1615e1f438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac05362-cf90-4c8a-aa49-a1615e1f438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93346598-92d3-424e-b70c-e204b0c66870', 'volume_name': 'volume-93346598-92d3-424e-b70c-e204b0c66870', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22314a4-0845-4443-a75c-ca47fabe0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22314a4-0845-4443-a75c-ca47fabe0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dd3bf3-6d0f-443d-a4bd-662a24f6d4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Volume 93346598-92d3-424e-b70c-e204b0c66870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93346598-92d3-424e-b70c-e204b0c66870', 'volume_size': 1} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1802905152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93346598-92d3-424e-b70c-e204b0c66870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e35d326be8f40678175839dda2c6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:43Z,use_quota=True,user_id='1c8ab8e394b642a2becb21c2aae66b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Creating volume 93346598-92d3-424e-b70c-e204b0c66870 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:23:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 1073741824 Sep 28 18:23:43 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 1073741824" returned: 0 in 1.083s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 Sep 28 18:23:44 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dd3bf3-6d0f-443d-a4bd-662a24f6d4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93346598-92d3-424e-b70c-e204b0c66870', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbef120-4c81-4c29-8f9e-e1c3590b7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Volume volume-93346598-92d3-424e-b70c-e204b0c66870 (93346598-92d3-424e-b70c-e204b0c66870): created successfully Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbef120-4c81-4c29-8f9e-e1c3590b7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Flow 'volume_create_manager' (57d01ed8-5db5-4a5f-944e-2d948ddbd3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4460600f-2bdf-4fb5-acb9-fd9704baf852 tempest-TestMinimumBasicScenario-745352783 None] Created volume successfully. Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e18bd312-680f-4c76-80e1-b7d20ffedb25 tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" by "attach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e18bd312-680f-4c76-80e1-b7d20ffedb25 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" acquired by "attach_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4847445-5b8e-4aa0-8b39-1981489ddeb7 req-6bdf1759-40a3-4fd2-838c-8e744d8e69bc tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4847445-5b8e-4aa0-8b39-1981489ddeb7 req-6bdf1759-40a3-4fd2-838c-8e744d8e69bc tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b4847445-5b8e-4aa0-8b39-1981489ddeb7 req-6bdf1759-40a3-4fd2-838c-8e744d8e69bc tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e18bd312-680f-4c76-80e1-b7d20ffedb25 tempest-VolumesActionsTest-880544991 None] Attaching volume cc5fb258-85ae-4095-b595-e74a9f0af644 to instance 519917c4-f616-4fdb-aa00-1450e5b2b84a at mountpoint /dev/vdb on host None. Sep 28 18:23:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-b4847445-5b8e-4aa0-8b39-1981489ddeb7 req-6bdf1759-40a3-4fd2-838c-8e744d8e69bc tempest-TestMinimumBasicScenario-745352783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-93346598-92d3-424e-b70c-e204b0c66870', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b140c625-fffb-4161-a4fa-f5b92a02efc5', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:23:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e18bd312-680f-4c76-80e1-b7d20ffedb25 tempest-VolumesActionsTest-880544991 None] Attach volume completed successfully. Sep 28 18:23:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e18bd312-680f-4c76-80e1-b7d20ffedb25 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" released by "attach_volume" :: held 0.248s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-b4847445-5b8e-4aa0-8b39-1981489ddeb7 req-6bdf1759-40a3-4fd2-838c-8e744d8e69bc tempest-TestMinimumBasicScenario-745352783 None] attachment_update completed successfully. Sep 28 18:23:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-40796d91-0617-436f-bb38-7958f745a69c tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" by "detach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-40796d91-0617-436f-bb38-7958f745a69c tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" acquired by "detach_volume" :: waited 0.093s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-40796d91-0617-436f-bb38-7958f745a69c tempest-VolumesActionsTest-880544991 None] Detaching volume cc5fb258-85ae-4095-b595-e74a9f0af644 from instance 519917c4-f616-4fdb-aa00-1450e5b2b84a. Sep 28 18:23:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-40796d91-0617-436f-bb38-7958f745a69c tempest-VolumesActionsTest-880544991 None] Detach volume completed successfully. Sep 28 18:23:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-40796d91-0617-436f-bb38-7958f745a69c tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" released by "detach_volume" :: held 0.331s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:24:00 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.566s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:24:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:24:01 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:INSERT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:01 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Acquiring lock "cinder-10eddff5-79e1-450d-b53f-768a2e40f58c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "cinder-10eddff5-79e1-450d-b53f-768a2e40f58c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Acquiring lock "cinder-quobyte-10eddff5-79e1-450d-b53f-768a2e40f58c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "cinder-quobyte-10eddff5-79e1-450d-b53f-768a2e40f58c" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba319507-76bc-481f-9937-40dc2448bc93]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c Sep 28 18:24:10 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c" returned: 0 in 0.467s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c Sep 28 18:24:11 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-10eddff5-79e1-450d-b53f-768a2e40f58c" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "cinder-quobyte-10eddff5-79e1-450d-b53f-768a2e40f58c" released by "delete_volume" :: held 0.827s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Created reservations ['627b01ee-8845-4975-9a57-df10c8dfbab7', 'd12a00c0-1b93-4da4-9994-b1893ec79f81', 'bf5335c7-1977-43d5-b654-9ed698e97bcb', '83a9e0f8-8f80-452e-980b-4b23d502cca9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:24:11 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-af3bbe5e-e488-4ed9-9629-f006ced0bdf2 tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" by "attach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-af3bbe5e-e488-4ed9-9629-f006ced0bdf2 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" acquired by "attach_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-af3bbe5e-e488-4ed9-9629-f006ced0bdf2 tempest-VolumesActionsTest-880544991 None] Attaching volume cc5fb258-85ae-4095-b595-e74a9f0af644 to instance 5877184d-0220-4039-a07a-83f5776f1ffd at mountpoint /dev/vdb on host None. Sep 28 18:24:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-af3bbe5e-e488-4ed9-9629-f006ced0bdf2 tempest-VolumesActionsTest-880544991 None] Attach volume completed successfully. Sep 28 18:24:12 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.310s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-af3bbe5e-e488-4ed9-9629-f006ced0bdf2 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644" released by "attach_volume" :: held 0.172s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Deleted volume successfully. Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0483ed5d-2195-4561-9fb2-c19be49879d7 tempest-VolumesNegativeTest-118645681 None] Lock "cinder-10eddff5-79e1-450d-b53f-768a2e40f58c-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-814f8cbe-549e-4cb9-957c-807cfac18fd0 tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" by "detach_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-814f8cbe-549e-4cb9-957c-807cfac18fd0 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-814f8cbe-549e-4cb9-957c-807cfac18fd0 tempest-VolumesActionsTest-880544991 None] Detaching volume cc5fb258-85ae-4095-b595-e74a9f0af644 from instance 5877184d-0220-4039-a07a-83f5776f1ffd. Sep 28 18:24:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-814f8cbe-549e-4cb9-957c-807cfac18fd0 tempest-VolumesActionsTest-880544991 None] Detach volume completed successfully. Sep 28 18:24:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-814f8cbe-549e-4cb9-957c-807cfac18fd0 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4013d07-73b0-4241-b5b7-9fc4771307e5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:18 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:24:18 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:18 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2c6c6-96e4-4a11-bf48-2409adaf2b82]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:18 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:24:18 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:19 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.499s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.12b4e9cb-1cf5-45df-a753-ee433d4cf7185tvq42rl.img {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:19 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.12b4e9cb-1cf5-45df-a753-ee433d4cf7185tvq42rl.img Sep 28 18:24:19 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (ecb86ba1-bb2f-4805-a80a-020ac17cb4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb08fb5c-a229-404c-8e9f-4f3c0e914aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb08fb5c-a229-404c-8e9f-4f3c0e914aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-223892287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a769fada-3b70-4c3b-a67c-9875eee7c306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:19Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a624d8-cb0b-48fe-8ced-d118e1b62739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a624d8-cb0b-48fe-8ced-d118e1b62739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49843d7-5b28-4931-bead-ded1149b6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49843d7-5b28-4931-bead-ded1149b6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a769fada-3b70-4c3b-a67c-9875eee7c306', 'volume_name': 'volume-a769fada-3b70-4c3b-a67c-9875eee7c306', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b264dbd-8cf9-4538-9fe9-90827ddfed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b264dbd-8cf9-4538-9fe9-90827ddfed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac164689-854f-46e9-9a50-6f2e2a73ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:19 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Volume a769fada-3b70-4c3b-a67c-9875eee7c306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a769fada-3b70-4c3b-a67c-9875eee7c306', 'volume_size': 1} Sep 28 18:24:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:29 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:29 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=9,cinder:SELECT=18,cinder:INSERT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:30 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.12b4e9cb-1cf5-45df-a753-ee433d4cf7185tvq42rl.img" returned: 0 in 11.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[23122e7a-df88-491d-94dd-b2cf445dc1e2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:24:30 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.882s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644, size 1024.00 MB, duration 11.06 sec, destination /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.12b4e9cb-1cf5-45df-a753-ee433d4cf7185tvq42rl.img {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:31 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Converted 1024.00 MB image at 92.58 MB/s Sep 28 18:24:31 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] 12b4e9cb-1cf5-45df-a753-ee433d4cf718 was raw, no need to convert to raw {{(pid=86560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:24:41 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5ec3d1c3-cf99-4a63-a735-1d2c74208e1d req-c1bec397-ec6e-4fe6-8bbd-d8b9f27de26c tempest-TestMinimumBasicScenario-745352783 None] Terminate volume connection completed successfully. Sep 28 18:24:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5ec3d1c3-cf99-4a63-a735-1d2c74208e1d req-c1bec397-ec6e-4fe6-8bbd-d8b9f27de26c tempest-TestMinimumBasicScenario-745352783 None] Deleting attachment b140c625-fffb-4161-a4fa-f5b92a02efc5. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "cinder-93346598-92d3-424e-b70c-e204b0c66870-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "cinder-93346598-92d3-424e-b70c-e204b0c66870-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "cinder-quobyte-93346598-92d3-424e-b70c-e204b0c66870" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "cinder-quobyte-93346598-92d3-424e-b70c-e204b0c66870" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af69c3b-68a3-4cc0-af36-650cf5965be8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 Sep 28 18:24:56 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870" returned: 0 in 0.630s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870 Sep 28 18:24:56 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93346598-92d3-424e-b70c-e204b0c66870" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "cinder-quobyte-93346598-92d3-424e-b70c-e204b0c66870" released by "delete_volume" :: held 1.083s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Created reservations ['ec6f3f3d-3312-4500-b789-eea5cb5b7c73', 'c65bf061-eda7-4e61-8358-eed01890755e', '762e6ea4-baf1-44ff-a29b-179468eb180e', '2674491a-d94d-4f08-85c3-213966b17a63'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.206s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Uploaded volume to glance image-id: 12b4e9cb-1cf5-45df-a753-ee433d4cf718. {{(pid=86560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.682s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-223892287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a769fada-3b70-4c3b-a67c-9875eee7c306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:19Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Creating volume a769fada-3b70-4c3b-a67c-9875eee7c306 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:57 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 1073741824 Sep 28 18:24:57 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-44357fa4-9f21-4ddd-8c7d-b7b59f6f9d09 tempest-VolumesActionsTest-880544991 None] Copy volume to image completed successfully. Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:24:57 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:58 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.566s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:58 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Deleted volume successfully. Sep 28 18:24:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2480b24b-53d9-43e8-a0a3-94c6cf744762 tempest-TestMinimumBasicScenario-745352783 None] Lock "cinder-93346598-92d3-424e-b70c-e204b0c66870-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:58 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 1073741824" returned: 0 in 1.091s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:58 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 Sep 28 18:24:58 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306" returned: 0 in 0.343s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac164689-854f-46e9-9a50-6f2e2a73ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a769fada-3b70-4c3b-a67c-9875eee7c306', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8ac328-180d-45cc-83f9-0025411aa36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Volume volume-a769fada-3b70-4c3b-a67c-9875eee7c306 (a769fada-3b70-4c3b-a67c-9875eee7c306): created successfully Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8ac328-180d-45cc-83f9-0025411aa36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (ecb86ba1-bb2f-4805-a80a-020ac17cb4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5850107a-5b8a-4ca6-ac83-893ceb280fa1 tempest-AttachVolumeNegativeTest-1323152625 None] Created volume successfully. Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ef66f-d0c4-4a38-a8bb-80d67ab7068b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:24:59 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.600s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:25:00 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d646da-a9cb-4e7b-9544-02d33c078c9d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:25:00 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.370s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5431f0ed-c9c2-46c8-96bd-8b08d130d5e7 req-99813e41-4b23-4e60-8303-e3b851338625 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:00 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.621s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img Sep 28 18:25:00 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:10 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:11 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img" returned: 0 in 10.444s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c9bd4-7405-4643-a72d-8afc8e55dd9c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:25:11 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.818s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644, size 1024.00 MB, duration 10.45 sec, destination /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:12 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Converted 1024.00 MB image at 98.03 MB/s Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] 3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599a was raw, converting to qcow2 {{(pid=86560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59abda3-9302-435f-a8f0-00ef51cb8c2a]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img Sep 28 18:25:12 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img" returned: 0 in 0.488s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img Sep 28 18:25:12 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img" returned: 1 in 0.602s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq Sep 28 18:25:13 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq" returned: 0 in 0.324s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Image conversion details: src /opt/stack/data/cinder/conversion/cc5fb258-85ae-4095-b595-e74a9f0af644.temp_image.3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599aldm01k6x.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:13 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae73fe7-2c17-41da-a3ff-c377ce022875]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq Sep 28 18:25:13 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hqkwu3iq" returned: 0 in 0.398s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.224s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Uploaded volume to glance image-id: 3d81fbbb-e3b6-45fa-a0dd-fc7d9fc6599a. {{(pid=86560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:25:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5431f0ed-c9c2-46c8-96bd-8b08d130d5e7 req-99813e41-4b23-4e60-8303-e3b851338625 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.174s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ac234289-652a-4e02-a4cb-d5258682a8fc tempest-VolumesActionsTest-880544991 None] Copy volume to image completed successfully. Sep 28 18:25:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5431f0ed-c9c2-46c8-96bd-8b08d130d5e7 req-99813e41-4b23-4e60-8303-e3b851338625 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:15 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5431f0ed-c9c2-46c8-96bd-8b08d130d5e7 req-99813e41-4b23-4e60-8303-e3b851338625 tempest-AttachVolumeNegativeTest-1323152625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-a769fada-3b70-4c3b-a67c-9875eee7c306', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '338303e7-fa26-4bdf-99c3-179f376cc343', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:25:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5431f0ed-c9c2-46c8-96bd-8b08d130d5e7 req-99813e41-4b23-4e60-8303-e3b851338625 tempest-AttachVolumeNegativeTest-1323152625 None] attachment_update completed successfully. Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Acquiring lock "cinder-quobyte-cc5fb258-85ae-4095-b595-e74a9f0af644" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "cinder-quobyte-cc5fb258-85ae-4095-b595-e74a9f0af644" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026c1d3-5981-42c5-80f3-8dc48950c056]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:25:18 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.585s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644 Sep 28 18:25:18 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cc5fb258-85ae-4095-b595-e74a9f0af644" returned: 0 in 0.302s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "cinder-quobyte-cc5fb258-85ae-4095-b595-e74a9f0af644" released by "delete_volume" :: held 0.972s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Created reservations ['6b1e1782-445a-4d5c-b9e9-5174e652672a', 'db86c06d-b950-4315-a3b2-d92a32f96b6c', '2ae8de32-865d-464c-a203-53aaae0ccc19', '9cd6a271-19d2-457e-bf48-fc2ea9754e5d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:25:18 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5b14c4b5-90cb-497a-be13-a2bca2b06238 req-1c900534-75e6-4800-95df-8c30e69368b7 tempest-AttachVolumeNegativeTest-1323152625 None] Terminate volume connection completed successfully. Sep 28 18:25:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5b14c4b5-90cb-497a-be13-a2bca2b06238 req-1c900534-75e6-4800-95df-8c30e69368b7 tempest-AttachVolumeNegativeTest-1323152625 None] Deleting attachment 338303e7-fa26-4bdf-99c3-179f376cc343. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:25:19 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.443s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Deleted volume successfully. Sep 28 18:25:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e669068-7e50-43af-b36e-4d4c8a3d2619 tempest-VolumesActionsTest-880544991 None] Lock "cinder-cc5fb258-85ae-4095-b595-e74a9f0af644-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:29 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:29 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Flow 'volume_create_manager' (817cad95-65b6-4b41-8b64-6eca00cdc2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b90e1d-f946-4e23-8c7e-29478bc8fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b90e1d-f946-4e23-8c7e-29478bc8fc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66deec2d-e5ef-4ade-a2e6-2dd42b43353c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f3663cccf940749921553b8bea43c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:31Z,use_quota=True,user_id='c5839e286b034f039c9938a70e6ef42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4770b0a6-93f2-44ae-b77d-3c02076b8132),volume_type_id=4770b0a6-93f2-44ae-b77d-3c02076b8132)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d86e065-282c-4d25-bfdf-5b3502cc07df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d86e065-282c-4d25-bfdf-5b3502cc07df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02428ae9-7232-470d-8692-1e8d520dab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02428ae9-7232-470d-8692-1e8d520dab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66deec2d-e5ef-4ade-a2e6-2dd42b43353c', 'volume_name': 'volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c', 'volume_size': 1, 'image_id': '301365c5-8f08-4388-9df6-e923f24dee23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6015046643127a7903fe9d1f55e0bca2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7f3663cccf940749921553b8bea43c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d19b260ee27d426f0a1fcc4ed73957a8d1ce5fb47961da67ec6ebab19d9e38ab157c65bd6280f20e6c40fac954f7d3d615c04a2b91e6a03b5445e36bc887d79', 'id': '301365c5-8f08-4388-9df6-e923f24dee23', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/301365c5-8f08-4388-9df6-e923f24dee23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9958a188-1c7e-4bc3-8279-ca211f1271f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9958a188-1c7e-4bc3-8279-ca211f1271f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a986ae-ef49-461f-b3be-a4e6c1444807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c', 'volume_size': 1, 'image_id': '301365c5-8f08-4388-9df6-e923f24dee23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6015046643127a7903fe9d1f55e0bca2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7f3663cccf940749921553b8bea43c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d19b260ee27d426f0a1fcc4ed73957a8d1ce5fb47961da67ec6ebab19d9e38ab157c65bd6280f20e6c40fac954f7d3d615c04a2b91e6a03b5445e36bc887d79', 'id': '301365c5-8f08-4388-9df6-e923f24dee23', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/301365c5-8f08-4388-9df6-e923f24dee23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:25:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Trying to clone 66deec2d-e5ef-4ade-a2e6-2dd42b43353c from image 301365c5-8f08-4388-9df6-e923f24dee23 at location (None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:25:32 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:25:32 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:25:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab1f33-011c-4f85-932a-c25da0c35f43]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:32 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:32 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:32 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:32 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:32 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Temporary image 301365c5-8f08-4388-9df6-e923f24dee23 is fetched for user c5839e286b034f039c9938a70e6ef42e. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940dc51-d62e-4b5a-aa4d-443b859548cc]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:33 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:33 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66deec2d-e5ef-4ade-a2e6-2dd42b43353c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f3663cccf940749921553b8bea43c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:31Z,use_quota=True,user_id='c5839e286b034f039c9938a70e6ef42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4770b0a6-93f2-44ae-b77d-3c02076b8132),volume_type_id=4770b0a6-93f2-44ae-b77d-3c02076b8132)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Creating volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:34 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1073741824 Sep 28 18:25:34 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1073741824" returned: 0 in 0.689s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c Sep 28 18:25:34 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" returned: 0 in 0.485s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Attempting download of 301365c5-8f08-4388-9df6-e923f24dee23 ((None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}])) to volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a304bf-70a2-48a0-9038-763f2b2ad703]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc Sep 28 18:25:35 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc" returned: 0 in 0.674s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Flow 'volume_create_manager' (dd3155f1-b65e-444c-a900-0fea7fbbb276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413e28c3-9f62-49f2-96ca-6154756dcfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413e28c3-9f62-49f2-96ca-6154756dcfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-263125992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b34067-1ec4-420e-b8b1-c8d0e352c89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6650e99cfd8d4b51bb9c0b04068122f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:36Z,use_quota=True,user_id='6af9a42250dc42839cb112c11f6a3d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb50e60-b5b5-4c55-9389-5bc05f4431d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb50e60-b5b5-4c55-9389-5bc05f4431d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756c90dd-d0ec-43ed-b209-f2c420116604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756c90dd-d0ec-43ed-b209-f2c420116604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b34067-1ec4-420e-b8b1-c8d0e352c89f', 'volume_name': 'volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc Sep 28 18:25:36 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce9ceb0-79b6-493e-b633-1ea1bc7be6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce9ceb0-79b6-493e-b633-1ea1bc7be6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2801f2d-557d-48ae-8947-d6eb6afacbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Volume 61b34067-1ec4-420e-b8b1-c8d0e352c89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f', 'volume_size': 1} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-263125992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b34067-1ec4-420e-b8b1-c8d0e352c89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6650e99cfd8d4b51bb9c0b04068122f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:36Z,use_quota=True,user_id='6af9a42250dc42839cb112c11f6a3d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Creating volume 61b34067-1ec4-420e-b8b1-c8d0e352c89f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:36 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f 1073741824 Sep 28 18:25:36 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc" returned: 1 in 0.736s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_301365c5-8f08-4388-9df6-e923f24dee23_8i3ki7bc' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a8393-b445-4bdf-ae90-b8de546e9dbc]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:37 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f 1073741824" returned: 0 in 0.777s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f Sep 28 18:25:37 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD Sep 28 18:25:37 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f" returned: 0 in 0.367s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2801f2d-557d-48ae-8947-d6eb6afacbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01acd6c-f547-4aaf-85d6-41801c0311e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:37 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Volume volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f (61b34067-1ec4-420e-b8b1-c8d0e352c89f): created successfully Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01acd6c-f547-4aaf-85d6-41801c0311e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Flow 'volume_create_manager' (dd3155f1-b65e-444c-a900-0fea7fbbb276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-abaa0d52-4671-4b26-94e8-c6a2b081dd0d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Created volume successfully. Sep 28 18:25:37 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] 301365c5-8f08-4388-9df6-e923f24dee23 was raw, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:25:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c Sep 28 18:25:37 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:38 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" returned: 0 in 0.826s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:38 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_301365c5-8f08-4388-9df6-e923f24dee23_9xxo8kywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:38 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:25:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:38 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1G Sep 28 18:25:38 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c 1G" returned: 0 in 0.885s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Downloaded image 301365c5-8f08-4388-9df6-e923f24dee23 ((None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}])) to volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Temporary image 301365c5-8f08-4388-9df6-e923f24dee23 for user c5839e286b034f039c9938a70e6ef42e is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Marking volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Copying metadata from image 301365c5-8f08-4388-9df6-e923f24dee23 to 66deec2d-e5ef-4ade-a2e6-2dd42b43353c. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Creating volume glance metadata for volume 66deec2d-e5ef-4ade-a2e6-2dd42b43353c backed by image 301365c5-8f08-4388-9df6-e923f24dee23 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '301365c5-8f08-4388-9df6-e923f24dee23', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6015046643127a7903fe9d1f55e0bca2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a986ae-ef49-461f-b3be-a4e6c1444807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c', 'volume_size': 1, 'image_id': '301365c5-8f08-4388-9df6-e923f24dee23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/301365c5-8f08-4388-9df6-e923f24dee23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6015046643127a7903fe9d1f55e0bca2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7f3663cccf940749921553b8bea43c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d19b260ee27d426f0a1fcc4ed73957a8d1ce5fb47961da67ec6ebab19d9e38ab157c65bd6280f20e6c40fac954f7d3d615c04a2b91e6a03b5445e36bc887d79', 'id': '301365c5-8f08-4388-9df6-e923f24dee23', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/301365c5-8f08-4388-9df6-e923f24dee23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda57abd-ce7d-4551-94d5-6c0201f719bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:39 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Volume volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c (66deec2d-e5ef-4ade-a2e6-2dd42b43353c): created successfully Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda57abd-ce7d-4551-94d5-6c0201f719bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Flow 'volume_create_manager' (817cad95-65b6-4b41-8b64-6eca00cdc2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-007d853f-7a0e-4f2c-a833-f1a46b40a44a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Created volume successfully. Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-8a659d3a-5921-4058-a1a8-2bd5c328b77b req-a7fb388d-72a5-4121-a1a0-9b9ca62a6f01 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-8a659d3a-5921-4058-a1a8-2bd5c328b77b req-a7fb388d-72a5-4121-a1a0-9b9ca62a6f01 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-8a659d3a-5921-4058-a1a8-2bd5c328b77b req-a7fb388d-72a5-4121-a1a0-9b9ca62a6f01 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-8a659d3a-5921-4058-a1a8-2bd5c328b77b req-a7fb388d-72a5-4121-a1a0-9b9ca62a6f01 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79d4161e-8595-46f7-b925-e1e0c39b796b', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:25:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-8a659d3a-5921-4058-a1a8-2bd5c328b77b req-a7fb388d-72a5-4121-a1a0-9b9ca62a6f01 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] attachment_update completed successfully. Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Acquiring lock "cinder-66deec2d-e5ef-4ade-a2e6-2dd42b43353c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "cinder-66deec2d-e5ef-4ade-a2e6-2dd42b43353c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Acquiring lock "cinder-quobyte-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "cinder-quobyte-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" acquired by "delete_volume" :: waited 0.072s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1190ac20-3b9f-4eca-9572-7bface4a350a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c Sep 28 18:25:41 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:41 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" returned: 0 in 0.730s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c Sep 28 18:25:41 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" returned: 0 in 0.650s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "cinder-quobyte-66deec2d-e5ef-4ade-a2e6-2dd42b43353c" released by "delete_volume" :: held 1.530s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:42 devstack cinder-volume[86560]: WARNING cinder.quota [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:25:42 devstack cinder-volume[86560]: WARNING cinder.quota [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Created reservations ['ce4224da-31e2-4577-ad17-11a3a7d21fe6', '1a79d597-c67a-45e8-8875-b2a6d43bb14f', 'ac6ccdc9-731d-4443-80b4-2c42b415090e', 'a05acbe0-cfd7-4453-96b7-19d4df9f36a5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:25:42 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.371s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Deleted volume successfully. Sep 28 18:25:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7a99df61-6a4e-43b3-888c-921dbd73d71a tempest-VolumeAndVolumeTypeFromImageTest-1519456038 None] Lock "cinder-66deec2d-e5ef-4ade-a2e6-2dd42b43353c-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-4f7ba4c4-ed65-4812-94a7-24848b0371a7 req-0853e59b-8bc0-4206-9e43-03292742468d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Terminate volume connection completed successfully. Sep 28 18:25:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-4f7ba4c4-ed65-4812-94a7-24848b0371a7 req-0853e59b-8bc0-4206-9e43-03292742468d tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Deleting attachment 79d4161e-8595-46f7-b925-e1e0c39b796b. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "cinder-61b34067-1ec4-420e-b8b1-c8d0e352c89f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "cinder-61b34067-1ec4-420e-b8b1-c8d0e352c89f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "cinder-quobyte-61b34067-1ec4-420e-b8b1-c8d0e352c89f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "cinder-quobyte-61b34067-1ec4-420e-b8b1-c8d0e352c89f" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[07620d5c-593a-4275-8d25-e61c28e0968e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f Sep 28 18:25:49 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f" returned: 0 in 0.702s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f Sep 28 18:25:49 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:50 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-61b34067-1ec4-420e-b8b1-c8d0e352c89f" returned: 0 in 0.464s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "cinder-quobyte-61b34067-1ec4-420e-b8b1-c8d0e352c89f" released by "delete_volume" :: held 1.294s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Created reservations ['1a8466dd-02c8-4d18-b21e-e302c70338e4', '43a5b14c-9a02-484d-abd6-ca17b9063f85', '83d99855-a28d-48a6-b04f-5bac1a3c169c', '19eba211-c1a3-429f-959d-c125ce1289c0'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:50 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:25:50 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:50 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.358s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Deleted volume successfully. Sep 28 18:25:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c5569813-8f90-4fe8-90d8-647cc1224dc4 tempest-TestServerVolumeAttachScenarioOldVersion-453500787 None] Lock "cinder-61b34067-1ec4-420e-b8b1-c8d0e352c89f-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (fbb81551-a6c7-413e-af01-e6136c7dac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aacf72f-500e-430f-b7d4-cf23af8ca73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aacf72f-500e-430f-b7d4-cf23af8ca73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-207069741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fce360-0dea-44f2-9183-deaa5ea0fe44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:52Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28a86c1-8e9b-44a5-b5a0-40d61bd89fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28a86c1-8e9b-44a5-b5a0-40d61bd89fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4b080c-be59-4f16-b34c-d5844eb6906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4b080c-be59-4f16-b34c-d5844eb6906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fce360-0dea-44f2-9183-deaa5ea0fe44', 'volume_name': 'volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c787bd-50f8-4f95-9bc8-4d646044f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c787bd-50f8-4f95-9bc8-4d646044f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e360ca0-9d4c-4516-9f83-0cd8b4d0a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Volume f8fce360-0dea-44f2-9183-deaa5ea0fe44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44', 'volume_size': 1} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-207069741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fce360-0dea-44f2-9183-deaa5ea0fe44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:52Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Creating volume f8fce360-0dea-44f2-9183-deaa5ea0fe44 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:52 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:52 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 1073741824 Sep 28 18:25:52 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (a1e4c79e-466d-48c6-b61d-49c0829b2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d61e9c0-8260-4fda-ab45-94385b4dd5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d61e9c0-8260-4fda-ab45-94385b4dd5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075664152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b809e-a1c1-4472-83a0-1cefedbe7156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:53Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d83dc1-dc6e-46e7-8f4d-3719bd4bc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d83dc1-dc6e-46e7-8f4d-3719bd4bc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4995b4aa-e715-4f55-84ed-d3034aea1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4995b4aa-e715-4f55-84ed-d3034aea1711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795b809e-a1c1-4472-83a0-1cefedbe7156', 'volume_name': 'volume-795b809e-a1c1-4472-83a0-1cefedbe7156', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96e3894-fbf3-4a74-a1ba-643a6a64e462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96e3894-fbf3-4a74-a1ba-643a6a64e462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3a00c6-1642-4aae-97a8-95074c95064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Volume 795b809e-a1c1-4472-83a0-1cefedbe7156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795b809e-a1c1-4472-83a0-1cefedbe7156', 'volume_size': 1} Sep 28 18:25:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:53 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 1073741824" returned: 0 in 1.309s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:53 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (2e4f2125-bd36-4140-af7d-97d48ffd69c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:53 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b284f24e-7e1d-48b5-a6ef-14b2726d89cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b284f24e-7e1d-48b5-a6ef-14b2726d89cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865260978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fff05c3-1c86-4e3d-a89d-8bca7fd9820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:53Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9767a3-3c86-4078-bb87-d26bb0ebbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9767a3-3c86-4078-bb87-d26bb0ebbd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4a21f6-3900-4f34-bf9e-702672069588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4a21f6-3900-4f34-bf9e-702672069588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fff05c3-1c86-4e3d-a89d-8bca7fd9820d', 'volume_name': 'volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33177c0-6f9c-445f-82f3-9946a5f89598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33177c0-6f9c-445f-82f3-9946a5f89598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124946c-2e32-45af-bbeb-4cf239890648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Volume 3fff05c3-1c86-4e3d-a89d-8bca7fd9820d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d', 'volume_size': 1} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:53 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44" returned: 0 in 0.519s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075664152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b809e-a1c1-4472-83a0-1cefedbe7156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:53Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Creating volume 795b809e-a1c1-4472-83a0-1cefedbe7156 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:53 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 1073741824 Sep 28 18:25:54 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e360ca0-9d4c-4516-9f83-0cd8b4d0a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adae26d-d4c3-40a5-9e73-c61aea70c27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Volume volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 (f8fce360-0dea-44f2-9183-deaa5ea0fe44): created successfully Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adae26d-d4c3-40a5-9e73-c61aea70c27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (fbb81551-a6c7-413e-af01-e6136c7dac4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (8ce154f2-488f-4419-86d1-e80b6e2a296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a8ee16-8094-4857-9ed6-6a33771fe300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7e638c7d-74f3-48db-8664-f9ef60762e6e tempest-CreateVolumesFromImageTest-1078354792 None] Created volume successfully. Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a8ee16-8094-4857-9ed6-6a33771fe300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225807185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4ba79a-6391-4507-941d-c8d2a8b7956c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:54Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a01b9b5-68af-4a7e-81ea-69239b9dc396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a01b9b5-68af-4a7e-81ea-69239b9dc396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383c2b28-06cb-4f7a-8c8e-02526221e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383c2b28-06cb-4f7a-8c8e-02526221e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4ba79a-6391-4507-941d-c8d2a8b7956c', 'volume_name': 'volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689ce56a-3580-4fd4-b170-fcfc6fb27a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689ce56a-3580-4fd4-b170-fcfc6fb27a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ecd213-05e6-46da-9b3e-8c494c4848a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Volume ad4ba79a-6391-4507-941d-c8d2a8b7956c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c', 'volume_size': 1} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:54 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (5f60f89e-23e2-4874-9d8b-3f2c067b7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf55cfea-8a86-46ea-a259-ad75a3ccc040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 1073741824" returned: 0 in 0.816s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf55cfea-8a86-46ea-a259-ad75a3ccc040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207819084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:55Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5b3b2e-1f6d-4de4-ae3d-2736efaba09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5b3b2e-1f6d-4de4-ae3d-2736efaba09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc60b57-542e-47fc-967b-1b05fb9350cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc60b57-542e-47fc-967b-1b05fb9350cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b', 'volume_name': 'volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884feee3-6e36-4a23-9428-4c79fa4ac393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884feee3-6e36-4a23-9428-4c79fa4ac393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b306d9-c5f5-402f-bb88-80c2cd498aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Volume d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b', 'volume_size': 1} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 Sep 28 18:25:54 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:55 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156" returned: 0 in 0.324s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865260978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fff05c3-1c86-4e3d-a89d-8bca7fd9820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:53Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Creating volume 3fff05c3-1c86-4e3d-a89d-8bca7fd9820d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:55 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3a00c6-1642-4aae-97a8-95074c95064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795b809e-a1c1-4472-83a0-1cefedbe7156', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d 1073741824 Sep 28 18:25:55 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016851d6-17b6-49ab-ad4c-72565c78e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Volume volume-795b809e-a1c1-4472-83a0-1cefedbe7156 (795b809e-a1c1-4472-83a0-1cefedbe7156): created successfully Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016851d6-17b6-49ab-ad4c-72565c78e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (a1e4c79e-466d-48c6-b61d-49c0829b2505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8ae303e6-c37f-4f16-b024-c95839e74daa tempest-CreateVolumesFromImageTest-1078354792 None] Created volume successfully. Sep 28 18:25:55 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d 1073741824" returned: 0 in 0.669s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d Sep 28 18:25:56 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225807185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4ba79a-6391-4507-941d-c8d2a8b7956c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:54Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Creating volume ad4ba79a-6391-4507-941d-c8d2a8b7956c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:56 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124946c-2e32-45af-bbeb-4cf239890648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5f41f5-c6f5-45d0-b5b3-8892a598a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c 1073741824 Sep 28 18:25:56 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Volume volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d (3fff05c3-1c86-4e3d-a89d-8bca7fd9820d): created successfully Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5f41f5-c6f5-45d0-b5b3-8892a598a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (2e4f2125-bd36-4140-af7d-97d48ffd69c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:56 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cc2cf178-cda0-4445-b2a9-aa725aace591 tempest-CreateVolumesFromImageTest-1078354792 None] Created volume successfully. Sep 28 18:25:57 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c 1073741824" returned: 0 in 0.741s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c Sep 28 18:25:57 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207819084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb5b122c4124b6a97dd5ba4f0801900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:55Z,use_quota=True,user_id='4c41ff84236240978b0f4255352dff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Creating volume d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:57 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b 1073741824 Sep 28 18:25:57 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ecd213-05e6-46da-9b3e-8c494c4848a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f76ad-5ccf-4255-ae74-f4700a0e07e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Volume volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c (ad4ba79a-6391-4507-941d-c8d2a8b7956c): created successfully Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f76ad-5ccf-4255-ae74-f4700a0e07e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (8ce154f2-488f-4419-86d1-e80b6e2a296b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b4a511e2-2a9a-4f0b-a8a6-f288e50e717a tempest-CreateVolumesFromImageTest-1078354792 None] Created volume successfully. Sep 28 18:25:58 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b 1073741824" returned: 0 in 0.664s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:58 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b Sep 28 18:25:58 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:58 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" returned: 0 in 0.280s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b306d9-c5f5-402f-bb88-80c2cd498aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5060700-b106-4810-8b9e-356f43516a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:58 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Volume volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b (d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b): created successfully Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5060700-b106-4810-8b9e-356f43516a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:58 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Flow 'volume_create_manager' (5f60f89e-23e2-4874-9d8b-3f2c067b7412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-544b2884-513d-446a-a13c-e418410a749b tempest-CreateVolumesFromImageTest-1078354792 None] Created volume successfully. Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-quobyte-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad675a80-6446-40fb-9e32-aa2837ff232e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:59 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b Sep 28 18:25:59 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" returned: 0 in 0.523s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b Sep 28 18:26:00 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:00 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:26:00 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b" released by "delete_volume" :: held 1.028s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Created reservations ['732051c1-d1e3-48d7-9429-d8650b617c3b', 'fac2ce69-b8e6-4adc-8431-314a929a5cf3', '5fd50704-00cd-4623-b7ba-d6a8118795f2', '07cb7663-978d-454d-916a-44dad693686d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:00 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Deleted volume successfully. Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3272bc03-91e1-4f74-af45-27c533d1b9cd tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-d86dcd0c-f5fa-4ca1-a40d-b8d42d94b06b-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-ad4ba79a-6391-4507-941d-c8d2a8b7956c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-ad4ba79a-6391-4507-941d-c8d2a8b7956c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-quobyte-ad4ba79a-6391-4507-941d-c8d2a8b7956c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-ad4ba79a-6391-4507-941d-c8d2a8b7956c" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afec3b-4aed-4148-9a74-671e42b41df9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c Sep 28 18:26:02 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c" returned: 0 in 0.544s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c Sep 28 18:26:02 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ad4ba79a-6391-4507-941d-c8d2a8b7956c" returned: 0 in 0.478s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-ad4ba79a-6391-4507-941d-c8d2a8b7956c" released by "delete_volume" :: held 1.128s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Created reservations ['6692a4d6-1c51-4bd0-bd09-05677c356ce6', '275ba363-2c60-44b7-a3f5-ceb44ebd6c9f', '115f4c16-fd8a-4acf-8237-f55fc39231a0', '482069ff-7aba-4f40-8467-362496631380'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:03 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.463s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Deleted volume successfully. Sep 28 18:26:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-490949d7-b2c1-4479-af4e-5881b114bfd0 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-ad4ba79a-6391-4507-941d-c8d2a8b7956c-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Flow 'volume_create_manager' (ffcdb7e7-d79d-49ec-8077-355478f0401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27feb534-e079-44fd-8b13-70da18a3562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27feb534-e079-44fd-8b13-70da18a3562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-67342011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b85f11-87e1-4102-a91b-8cec8f90a8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad81e82bb8942b1a3e130e70621b1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:04Z,use_quota=True,user_id='1083e45e37c9408090085b43b3c66463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbd8ea2-77ad-4243-9466-8ecb1abcbf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbd8ea2-77ad-4243-9466-8ecb1abcbf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d4d77-a3d3-4869-84c3-87194c43128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d4d77-a3d3-4869-84c3-87194c43128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b85f11-87e1-4102-a91b-8cec8f90a8f2', 'volume_name': 'volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f275c5b9-3c70-40b6-8c36-d99057c79fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f275c5b9-3c70-40b6-8c36-d99057c79fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d10c167-353e-406e-a96c-6bcc667a4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Volume 64b85f11-87e1-4102-a91b-8cec8f90a8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2', 'volume_size': 1} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-67342011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b85f11-87e1-4102-a91b-8cec8f90a8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad81e82bb8942b1a3e130e70621b1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:04Z,use_quota=True,user_id='1083e45e37c9408090085b43b3c66463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Creating volume 64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:04 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 1073741824 Sep 28 18:26:04 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-quobyte-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d550db1f-39d9-4fa5-a45a-bf1efb85c74d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d Sep 28 18:26:04 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" returned: 0 in 0.536s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 1073741824" returned: 0 in 0.681s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d Sep 28 18:26:04 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:05 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:05 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" returned: 0 in 0.357s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d" released by "delete_volume" :: held 0.949s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:05 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d10c167-353e-406e-a96c-6bcc667a4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a97d4a5-f6f8-477a-a460-05ef94e104b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Volume volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 (64b85f11-87e1-4102-a91b-8cec8f90a8f2): created successfully Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a97d4a5-f6f8-477a-a460-05ef94e104b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Flow 'volume_create_manager' (ffcdb7e7-d79d-49ec-8077-355478f0401d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Created reservations ['651ecb29-e607-4f6b-b324-583e44cf4516', '03daa4d3-6ef5-4534-b0c8-a4a268f84f42', '33bc10a5-cb70-4bee-9b9e-7385d0f5d867', '6a4f1dc9-2aa6-4f73-a5e6-15f2f868a3b0'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-629e0677-a6a6-46c3-9081-069c05280269 tempest-TestImageHashVerification-1049004176 None] Created volume successfully. Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:05 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:05 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.297s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Deleted volume successfully. Sep 28 18:26:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b488c55a-66e9-4832-9156-62eff8046714 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-3fff05c3-1c86-4e3d-a89d-8bca7fd9820d-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-795b809e-a1c1-4472-83a0-1cefedbe7156-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-795b809e-a1c1-4472-83a0-1cefedbe7156-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-quobyte-795b809e-a1c1-4472-83a0-1cefedbe7156" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-795b809e-a1c1-4472-83a0-1cefedbe7156" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8a894-af83-430a-bbfc-114750bdc8fe]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (897bf7a9-05b4-4a11-9b8c-4cb6e4dc345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db40964b-32d2-4c17-81ae-f4dae021dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db40964b-32d2-4c17-81ae-f4dae021dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-18116246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1b58c1-357f-4741-a853-2b18c25575ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:07Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c412dac6-19bc-4541-a601-18a9b92a52fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c412dac6-19bc-4541-a601-18a9b92a52fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6b2ba2-78dd-4514-a156-62bc0d75e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6b2ba2-78dd-4514-a156-62bc0d75e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1b58c1-357f-4741-a853-2b18c25575ad', 'volume_name': 'volume-2b1b58c1-357f-4741-a853-2b18c25575ad', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208147fd-663e-4b21-99e3-747ce517e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208147fd-663e-4b21-99e3-747ce517e732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a3dbb-476d-4651-b9e8-f9fba62b77d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Volume 2b1b58c1-357f-4741-a853-2b18c25575ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1b58c1-357f-4741-a853-2b18c25575ad', 'volume_size': 1} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-18116246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1b58c1-357f-4741-a853-2b18c25575ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6e8902fba94612bcea0e2a8ea9dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:07Z,use_quota=True,user_id='54daf5efc37c488ba6fef7a8c609b02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Creating volume 2b1b58c1-357f-4741-a853-2b18c25575ad {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:06 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:06 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 Sep 28 18:26:06 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad 1073741824 Sep 28 18:26:07 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156" returned: 0 in 0.690s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156 Sep 28 18:26:07 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad 1073741824" returned: 0 in 0.791s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad Sep 28 18:26:07 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-795b809e-a1c1-4472-83a0-1cefedbe7156" returned: 0 in 0.499s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-795b809e-a1c1-4472-83a0-1cefedbe7156" released by "delete_volume" :: held 1.268s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Created reservations ['9b35182e-f39d-418c-beb1-163c7873df3e', 'a812900e-f818-40f8-ba71-87b2e2dc111b', 'ddd71dc2-fd93-4f80-86a0-443dc2b91bae', '38d65252-8b94-4712-8b09-f256a194a408'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:08 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.073s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a3dbb-476d-4651-b9e8-f9fba62b77d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1b58c1-357f-4741-a853-2b18c25575ad', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d4f9ca-1ac8-4972-9bf5-8821a90a3307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[da68f1e6-01cd-41e6-8bd3-4198e18a794a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Volume volume-2b1b58c1-357f-4741-a853-2b18c25575ad (2b1b58c1-357f-4741-a853-2b18c25575ad): created successfully Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d4f9ca-1ac8-4972-9bf5-8821a90a3307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Flow 'volume_create_manager' (897bf7a9-05b4-4a11-9b8c-4cb6e4dc345b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5cc74fe7-7f3d-48a1-8db3-0ae8cb412c4a tempest-AttachVolumeNegativeTest-1323152625 None] Created volume successfully. Sep 28 18:26:08 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:08 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:08 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:08 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:08 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Deleted volume successfully. Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1dfd93b3-68f1-4cfd-adfa-b34ba3332880 tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-795b809e-a1c1-4472-83a0-1cefedbe7156-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:08 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.495s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68ea426-8b67-42e9-abb9-4c7d15707fb2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:08 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-f8fce360-0dea-44f2-9183-deaa5ea0fe44-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-f8fce360-0dea-44f2-9183-deaa5ea0fe44-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "cinder-quobyte-f8fce360-0dea-44f2-9183-deaa5ea0fe44" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-f8fce360-0dea-44f2-9183-deaa5ea0fe44" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c274bb-d47d-40b7-a73f-3e2412879a51]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:09 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 Sep 28 18:26:09 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:09 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.727s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 /opt/stack/data/cinder/conversion/64b85f11-87e1-4102-a91b-8cec8f90a8f2.temp_image.5f00e7b8-d5d4-45d5-ab4d-96e357b0780chqvhfpot.img {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:09 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 /opt/stack/data/cinder/conversion/64b85f11-87e1-4102-a91b-8cec8f90a8f2.temp_image.5f00e7b8-d5d4-45d5-ab4d-96e357b0780chqvhfpot.img Sep 28 18:26:09 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:09 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44" returned: 0 in 0.626s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:09 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44 Sep 28 18:26:09 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:10 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f8fce360-0dea-44f2-9183-deaa5ea0fe44" returned: 0 in 0.557s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-quobyte-f8fce360-0dea-44f2-9183-deaa5ea0fe44" released by "delete_volume" :: held 1.281s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-70ef1258-20f4-4189-98ca-110c1245f008 req-c6042525-40d2-47b0-83b9-6b3906bbffad tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Created reservations ['85940bbd-a797-49c4-8c6e-f55c696a5e77', '288753f4-2763-4d59-8b9f-74ce5cebd78a', '80a42004-821a-41cf-8f1e-784c9f66903b', '0adae0b6-3710-4897-b91d-454c945d26b7'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:10 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:10 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:11 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.487s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:11 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Deleted volume successfully. Sep 28 18:26:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9062931f-4364-465b-8f82-9375e614fbcb tempest-CreateVolumesFromImageTest-1078354792 None] Lock "cinder-f8fce360-0dea-44f2-9183-deaa5ea0fe44-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:17 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 /opt/stack/data/cinder/conversion/64b85f11-87e1-4102-a91b-8cec8f90a8f2.temp_image.5f00e7b8-d5d4-45d5-ab4d-96e357b0780chqvhfpot.img" returned: 0 in 8.357s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0ff30-09ed-4a9a-8e49-5de03ee568e6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:17 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (9e81ab73-8d43-49a5-9f09-b958d722496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79ecf77-0572-4c6d-a668-c1b2e416b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79ecf77-0572-4c6d-a668-c1b2e416b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814162589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1909abb2-5d10-48b5-be01-5ac9ad3bd7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:18Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6480d2d-4205-48f2-bd3a-170240e6d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6480d2d-4205-48f2-bd3a-170240e6d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79459e5d-8f2c-44d6-89f6-6d4eeec0d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79459e5d-8f2c-44d6-89f6-6d4eeec0d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1909abb2-5d10-48b5-be01-5ac9ad3bd7fa', 'volume_name': 'volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9efe2a-5f3b-426b-beb1-c1080586813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9efe2a-5f3b-426b-beb1-c1080586813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30d6976-4ff0-4aac-adfd-4606358d7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume 1909abb2-5d10-48b5-be01-5ac9ad3bd7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa', 'volume_size': 1} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:18 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.619s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/conversion/64b85f11-87e1-4102-a91b-8cec8f90a8f2.temp_image.5f00e7b8-d5d4-45d5-ab4d-96e357b0780chqvhfpot.img {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:18 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Converted 1024.00 MB image at 122.50 MB/s Sep 28 18:26:18 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] 5f00e7b8-d5d4-45d5-ab4d-96e357b0780c was raw, no need to convert to raw {{(pid=86560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:26:28 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=89,cinder:SELECT=59,cinder:INSERT=24,cinder:DELETE=11 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:28 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=82,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.976s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Uploaded volume to glance image-id: 5f00e7b8-d5d4-45d5-ab4d-96e357b0780c. {{(pid=86560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-70ef1258-20f4-4189-98ca-110c1245f008 req-c6042525-40d2-47b0-83b9-6b3906bbffad tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 31.668s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-70ef1258-20f4-4189-98ca-110c1245f008 req-c6042525-40d2-47b0-83b9-6b3906bbffad tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.078s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814162589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1909abb2-5d10-48b5-be01-5ac9ad3bd7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:18Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume 1909abb2-5d10-48b5-be01-5ac9ad3bd7fa {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1f6d0582-9e01-4ecd-9747-9b02e8f32e01 tempest-TestImageHashVerification-1049004176 None] Copy volume to image completed successfully. Sep 28 18:26:42 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa 1073741824 Sep 28 18:26:42 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-70ef1258-20f4-4189-98ca-110c1245f008 req-c6042525-40d2-47b0-83b9-6b3906bbffad tempest-AttachVolumeNegativeTest-1323152625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-2b1b58c1-357f-4741-a853-2b18c25575ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae8bb1e7-6eca-4569-bcd2-9299c9f67465', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:26:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-70ef1258-20f4-4189-98ca-110c1245f008 req-c6042525-40d2-47b0-83b9-6b3906bbffad tempest-AttachVolumeNegativeTest-1323152625 None] attachment_update completed successfully. Sep 28 18:26:42 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa 1073741824" returned: 0 in 0.749s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:43 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa Sep 28 18:26:43 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:43 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" returned: 0 in 0.342s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30d6976-4ff0-4aac-adfd-4606358d7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835ee79-c918-4882-b955-77c4cf77c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa (1909abb2-5d10-48b5-be01-5ac9ad3bd7fa): created successfully Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835ee79-c918-4882-b955-77c4cf77c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (9e81ab73-8d43-49a5-9f09-b958d722496b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-be7bbf3d-a19d-4ed1-b060-3275af54a9e3 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "cinder-64b85f11-87e1-4102-a91b-8cec8f90a8f2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "cinder-64b85f11-87e1-4102-a91b-8cec8f90a8f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "cinder-quobyte-64b85f11-87e1-4102-a91b-8cec8f90a8f2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "cinder-quobyte-64b85f11-87e1-4102-a91b-8cec8f90a8f2" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be93096-4698-4e55-9beb-1265d5ca4100]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:43 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:43 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.691s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:44 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2 Sep 28 18:26:44 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (ddfdccc2-41aa-47ff-a0bd-ca3d66cd29d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c90fca-d51e-4673-9ac4-f3165b1c6085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c90fca-d51e-4673-9ac4-f3165b1c6085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410921797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fca1f8-f451-48d4-b074-3b74f70944d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ba0aa3-cf2d-4cc4-ae27-ac145dca5575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ba0aa3-cf2d-4cc4-ae27-ac145dca5575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4200ad57-ce48-4275-9fa0-a064a471e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4200ad57-ce48-4275-9fa0-a064a471e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fca1f8-f451-48d4-b074-3b74f70944d7', 'volume_name': 'volume-a9fca1f8-f451-48d4-b074-3b74f70944d7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074cbc2d-29a7-4f64-a69d-865db3a51404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074cbc2d-29a7-4f64-a69d-865db3a51404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ae79fc-f53c-44d6-87c0-5bf7ff02f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume a9fca1f8-f451-48d4-b074-3b74f70944d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fca1f8-f451-48d4-b074-3b74f70944d7', 'volume_size': 1} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410921797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fca1f8-f451-48d4-b074-3b74f70944d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume a9fca1f8-f451-48d4-b074-3b74f70944d7 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:44 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:44 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-64b85f11-87e1-4102-a91b-8cec8f90a8f2" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:44 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 1073741824 Sep 28 18:26:44 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "cinder-quobyte-64b85f11-87e1-4102-a91b-8cec8f90a8f2" released by "delete_volume" :: held 1.254s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Created reservations ['78a5052e-c138-476d-9c05-6621bf3fa1f7', '79227bb1-d1ba-4f0f-83bd-4bc2aaf4fbb4', '929cbded-b2e5-4ee4-b538-4e01f3786d4d', '5c13f777-d248-4d91-9535-9156418a6efc'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:45 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:45 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (fc0174d3-3962-4093-8e78-76f8d5b94a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a492fc7b-d897-45c9-83f9-a99288c6de62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a492fc7b-d897-45c9-83f9-a99288c6de62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037134527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a723aa25-cc15-4cc3-b6e3-b02806b06a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e0b6f0-e608-4c3b-a03a-b2a3495e17cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e0b6f0-e608-4c3b-a03a-b2a3495e17cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87df08d-1b84-4a0b-88d0-7c8a4ca710d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87df08d-1b84-4a0b-88d0-7c8a4ca710d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a723aa25-cc15-4cc3-b6e3-b02806b06a66', 'volume_name': 'volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b48841a-ecf5-40ac-84f5-0ff36e2bf49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b48841a-ecf5-40ac-84f5-0ff36e2bf49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6951e6-5006-4936-b27b-f19134c85099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume a723aa25-cc15-4cc3-b6e3-b02806b06a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66', 'volume_size': 1} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 1073741824" returned: 0 in 1.113s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:46 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-d98d5e45-3dfb-4ed8-8319-dfd4f924bbf7 req-94820335-cb2a-4742-b268-202156139f2f tempest-AttachVolumeNegativeTest-1323152625 None] Terminate volume connection completed successfully. Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-d98d5e45-3dfb-4ed8-8319-dfd4f924bbf7 req-94820335-cb2a-4742-b268-202156139f2f tempest-AttachVolumeNegativeTest-1323152625 None] Deleting attachment ae8bb1e7-6eca-4569-bcd2-9299c9f67465. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.696s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Deleted volume successfully. Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-59536f5d-98a3-4569-9761-1ab1132b9c59 tempest-TestImageHashVerification-1049004176 None] Lock "cinder-64b85f11-87e1-4102-a91b-8cec8f90a8f2-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:46 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 Sep 28 18:26:46 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (6abcdc18-6ca0-4324-bbd0-dad23a0cfc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f2bfd1-7428-4b1a-913d-3a6f417102a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f2bfd1-7428-4b1a-913d-3a6f417102a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556083150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add20897-18f6-46d3-92cb-6a7619ebe256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:46Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13d496e-a05d-4735-ac23-a60668ae487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13d496e-a05d-4735-ac23-a60668ae487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25f5a46-f625-4b9d-a894-ee1503914024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25f5a46-f625-4b9d-a894-ee1503914024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add20897-18f6-46d3-92cb-6a7619ebe256', 'volume_name': 'volume-add20897-18f6-46d3-92cb-6a7619ebe256', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c0d2a7-7a9b-41c6-86f2-633fa281f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c0d2a7-7a9b-41c6-86f2-633fa281f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe3b5f-bc89-42a4-bc35-89b403ee5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume add20897-18f6-46d3-92cb-6a7619ebe256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add20897-18f6-46d3-92cb-6a7619ebe256', 'volume_size': 1} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:46 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7" returned: 0 in 0.523s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037134527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a723aa25-cc15-4cc3-b6e3-b02806b06a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume a723aa25-cc15-4cc3-b6e3-b02806b06a66 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ae79fc-f53c-44d6-87c0-5bf7ff02f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fca1f8-f451-48d4-b074-3b74f70944d7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fedc1fe-5066-4630-b30a-0514edae8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 1073741824 Sep 28 18:26:46 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 (a9fca1f8-f451-48d4-b074-3b74f70944d7): created successfully Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fedc1fe-5066-4630-b30a-0514edae8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (ddfdccc2-41aa-47ff-a0bd-ca3d66cd29d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-473ff4ff-bf43-47db-8212-24f21f67b3d5 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (7f121ae8-4667-4a78-ae87-00997e2b50ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1279b8-fbb6-4fad-a177-75512a9022f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1279b8-fbb6-4fad-a177-75512a9022f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689651362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:47Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a5d367-af7b-4bc8-be32-afa1eaa8d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a5d367-af7b-4bc8-be32-afa1eaa8d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356dfe26-b6bc-42a4-947d-eec3861aba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356dfe26-b6bc-42a4-947d-eec3861aba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f', 'volume_name': 'volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef00b0-c2ad-48a9-90f2-56b1ac10f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef00b0-c2ad-48a9-90f2-56b1ac10f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d560b111-b688-4487-8b60-7cfefd93f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume 8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f', 'volume_size': 1} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:47 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 1073741824" returned: 0 in 0.972s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:47 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 Sep 28 18:26:47 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (4b5b746d-9bc4-4b10-8a92-f0b4f39fca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed1ad3-6d4b-44e7-a191-806371edfde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed1ad3-6d4b-44e7-a191-806371edfde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1790397748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4376c1-55bc-469f-bc3e-a8ee2baf1406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:48Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0651879f-f437-49cf-9517-d8924667a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0651879f-f437-49cf-9517-d8924667a53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ead80-e2a8-4c73-8a55-e09cd21527ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ead80-e2a8-4c73-8a55-e09cd21527ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4376c1-55bc-469f-bc3e-a8ee2baf1406', 'volume_name': 'volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e028b124-9af9-4dca-bc18-8bc38ca876f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e028b124-9af9-4dca-bc18-8bc38ca876f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6c7c8-d10c-4133-9ff6-00232977bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume 0e4376c1-55bc-469f-bc3e-a8ee2baf1406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406', 'volume_size': 1} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66" returned: 0 in 0.548s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556083150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add20897-18f6-46d3-92cb-6a7619ebe256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:46Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume add20897-18f6-46d3-92cb-6a7619ebe256 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:48 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6951e6-5006-4936-b27b-f19134c85099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87821c3a-adc6-463b-8479-1be6871ee176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:48 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 1073741824 Sep 28 18:26:48 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 (a723aa25-cc15-4cc3-b6e3-b02806b06a66): created successfully Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87821c3a-adc6-463b-8479-1be6871ee176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (fc0174d3-3962-4093-8e78-76f8d5b94a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-51689632-c534-4473-b655-1cc8034ad616 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:49 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 1073741824" returned: 0 in 0.834s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:49 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 Sep 28 18:26:49 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:49 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256" returned: 0 in 0.304s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689651362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:47Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume 8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:49 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:49 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f 1073741824 Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe3b5f-bc89-42a4-bc35-89b403ee5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add20897-18f6-46d3-92cb-6a7619ebe256', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58672655-2df5-48ec-b24a-4c3c47d7bf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-add20897-18f6-46d3-92cb-6a7619ebe256 (add20897-18f6-46d3-92cb-6a7619ebe256): created successfully Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58672655-2df5-48ec-b24a-4c3c47d7bf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (6abcdc18-6ca0-4324-bbd0-dad23a0cfc07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-02879b32-d842-4c15-9269-198565578349 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:50 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f 1073741824" returned: 0 in 0.640s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:50 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f Sep 28 18:26:50 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:50 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.349s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1790397748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4376c1-55bc-469f-bc3e-a8ee2baf1406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b915300ed4245f096d374b65e2c33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:48Z,use_quota=True,user_id='d43d258618e9445fa73801d18d148a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Creating volume 0e4376c1-55bc-469f-bc3e-a8ee2baf1406 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:50 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:50 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 1073741824 Sep 28 18:26:50 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d560b111-b688-4487-8b60-7cfefd93f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a6e27-4e3a-4d21-b111-fc4ca37d1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f (8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f): created successfully Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a6e27-4e3a-4d21-b111-fc4ca37d1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (7f121ae8-4667-4a78-ae87-00997e2b50ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-37acc3e9-0950-4b98-97ec-e334e72d2584 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:51 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 1073741824" returned: 0 in 0.797s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:51 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 Sep 28 18:26:51 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:51 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" returned: 0 in 0.270s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6c7c8-d10c-4133-9ff6-00232977bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42d8c99-f3f2-4693-b5a3-2f80909169cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:51 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Volume volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 (0e4376c1-55bc-469f-bc3e-a8ee2baf1406): created successfully Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42d8c99-f3f2-4693-b5a3-2f80909169cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Flow 'volume_create_manager' (4b5b746d-9bc4-4b10-8a92-f0b4f39fca60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ceca7ab9-2baf-4d5b-8c58-6e5c4d7ec7d6 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created volume successfully. Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-0e4376c1-55bc-469f-bc3e-a8ee2baf1406-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-0e4376c1-55bc-469f-bc3e-a8ee2baf1406-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d488ffdb-8171-4648-bb8d-95d5e742eb3a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:52 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 Sep 28 18:26:52 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:53 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" returned: 0 in 0.502s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:53 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406 Sep 28 18:26:53 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:53 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" returned: 0 in 0.296s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-0e4376c1-55bc-469f-bc3e-a8ee2baf1406" released by "delete_volume" :: held 0.875s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['50b38307-1788-4db4-b545-c517ee11b0c0', '0cd0874b-ca39-4fcd-bac3-2c0216b52a50', '25517796-5d59-48b4-bd1c-2803999a40f7', '0e511b63-a181-4017-a9fe-64e2a3536ac5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:53 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:53 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fffcc8-136e-483b-aa01-8e2d2b1880d2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:54 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.405s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-284f11d6-fa03-411e-ada2-ffebebeaf15e tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-0e4376c1-55bc-469f-bc3e-a8ee2baf1406-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:54 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f Sep 28 18:26:54 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:54 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:54 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f Sep 28 18:26:54 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:54 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" returned: 0 in 0.324s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f" released by "delete_volume" :: held 0.871s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['73547bd7-4ef1-4392-9730-a5e779d840db', 'be05599f-0a2a-42c9-8a7c-73acdcbb2f43', '171357d1-0393-403c-b31d-10fe6217409b', 'a841951f-a89a-4e73-a2fd-57d39eda3f09'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:55 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:55 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:55 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e7f9927a-cc19-4756-8692-ede202740b3d tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-8964cf28-a86a-4d2b-a05d-d0a3c69a3a3f-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-2b1b58c1-357f-4741-a853-2b18c25575ad-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-2b1b58c1-357f-4741-a853-2b18c25575ad-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-quobyte-2b1b58c1-357f-4741-a853-2b18c25575ad" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-2b1b58c1-357f-4741-a853-2b18c25575ad" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd5b9c7-469c-4f1d-9267-77976781e7b8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad Sep 28 18:26:56 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-add20897-18f6-46d3-92cb-6a7619ebe256-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-add20897-18f6-46d3-92cb-6a7619ebe256-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Flow 'volume_create_manager' (6ba57a05-6a72-4079-a212-65ab2c6f0841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edf19c2-e2d5-468e-84b8-1ed080f7cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edf19c2-e2d5-468e-84b8-1ed080f7cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-453796510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb404506-21c6-44cf-98db-d6bfcaa23e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a3d8d4794243dd8e77e2e7dbce6d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:56Z,use_quota=True,user_id='3880285ebc2744a88bc5744ad7bbe9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc85952-58fe-486f-90ca-e62f7a6a23c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc85952-58fe-486f-90ca-e62f7a6a23c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5709830e-9830-415f-b788-aec794bbe905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-add20897-18f6-46d3-92cb-6a7619ebe256" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-add20897-18f6-46d3-92cb-6a7619ebe256" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5cecd0-7439-4202-aa22-986c624bce0a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad" returned: 0 in 0.521s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 Sep 28 18:26:56 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad Sep 28 18:26:56 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5709830e-9830-415f-b788-aec794bbe905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb404506-21c6-44cf-98db-d6bfcaa23e83', 'volume_name': 'volume-bb404506-21c6-44cf-98db-d6bfcaa23e83', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111166e3-253f-47fc-bc98-dcbbeea954a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111166e3-253f-47fc-bc98-dcbbeea954a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b8cfa-9acb-4955-b774-a4a483c938dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Volume bb404506-21c6-44cf-98db-d6bfcaa23e83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb404506-21c6-44cf-98db-d6bfcaa23e83', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Trying to clone bb404506-21c6-44cf-98db-d6bfcaa23e83 from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:26:56 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2b1b58c1-357f-4741-a853-2b18c25575ad" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-2b1b58c1-357f-4741-a853-2b18c25575ad" released by "delete_volume" :: held 0.913s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256" returned: 0 in 0.614s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256 Sep 28 18:26:57 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Created reservations ['829372cd-f06f-4cbe-8164-cb9f553921ec', 'baf253c5-10b3-4d40-af93-14ba3f14a094', '1bf88642-604b-447f-9a91-b8060e5bed8d', '94428b5b-4bd7-4347-bb64-e7033f9a75b4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:57 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:26:57 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-add20897-18f6-46d3-92cb-6a7619ebe256" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-add20897-18f6-46d3-92cb-6a7619ebe256" released by "delete_volume" :: held 1.043s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[805dbe0f-0ee4-4677-adf8-1226000a21b1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['5425990b-8b05-4fe0-a7db-343834a4765b', '886acd2d-3581-4bbd-ae0e-a871eb2283ce', '5195fad6-d358-4364-9cd4-182339af5a6c', '70bca2e6-68ac-4fc3-afce-bb7ed9bea790'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD Sep 28 18:26:57 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:57 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.408s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Deleted volume successfully. Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4b0a623d-a51c-421d-9479-2c285dbc41e4 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-2b1b58c1-357f-4741-a853-2b18c25575ad-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-85066741-5ccb-4196-b241-b4b035beb381 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-add20897-18f6-46d3-92cb-6a7619ebe256-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 is fetched for user 3880285ebc2744a88bc5744ad7bbe9e1. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaeaf34-6a62-4315-87b2-3d5e157985b7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD Sep 28 18:26:58 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-a769fada-3b70-4c3b-a67c-9875eee7c306-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-a769fada-3b70-4c3b-a67c-9875eee7c306-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-quobyte-a769fada-3b70-4c3b-a67c-9875eee7c306" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-a769fada-3b70-4c3b-a67c-9875eee7c306" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-453796510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb404506-21c6-44cf-98db-d6bfcaa23e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a3d8d4794243dd8e77e2e7dbce6d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:56Z,use_quota=True,user_id='3880285ebc2744a88bc5744ad7bbe9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Creating volume bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:58 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc27199-c672-4f85-b39d-a357458e3abf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1073741824 Sep 28 18:26:58 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 Sep 28 18:26:58 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-a723aa25-cc15-4cc3-b6e3-b02806b06a66-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-a723aa25-cc15-4cc3-b6e3-b02806b06a66-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-a723aa25-cc15-4cc3-b6e3-b02806b06a66" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-a723aa25-cc15-4cc3-b6e3-b02806b06a66" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c39ae2-8957-44c4-8b94-80d46c54a829]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306" returned: 0 in 0.434s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306 Sep 28 18:26:58 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 Sep 28 18:26:59 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1073741824" returned: 0 in 0.670s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 Sep 28 18:26:59 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a769fada-3b70-4c3b-a67c-9875eee7c306" returned: 0 in 0.462s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-a769fada-3b70-4c3b-a67c-9875eee7c306" released by "delete_volume" :: held 0.968s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Created reservations ['30e650ab-1825-4f6c-97ab-461ce1fba938', 'e5868a6e-dada-492e-9615-263f49e9abba', '27e582b9-8d40-489d-9589-87a9bb60c814', '88f2f2ec-e44d-49f1-a822-1e754aca8ccb'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:59 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66" returned: 0 in 0.698s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66 Sep 28 18:26:59 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:26:59 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83" returned: 0 in 0.535s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Attempting download of 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume bb404506-21c6-44cf-98db-d6bfcaa23e83. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[67805b7a-582b-4d42-a12e-d061f6384384]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a723aa25-cc15-4cc3-b6e3-b02806b06a66" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-a723aa25-cc15-4cc3-b6e3-b02806b06a66" released by "delete_volume" :: held 1.179s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.413s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Deleted volume successfully. Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl Sep 28 18:27:00 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bf34313b-825b-4167-a355-7b990c89a8ec tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-a769fada-3b70-4c3b-a67c-9875eee7c306-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['9b2c268c-eb2c-4d31-bc3a-a720dd434d5f', 'ed0d022d-06e0-49b1-9992-419db550fc6c', '4f50ceb8-7b17-4a53-8e1a-7b6dbce26c03', '02d0ecb1-99cd-40ba-974c-c68c4f46872d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:00 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl" returned: 0 in 0.551s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:27:00 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl Sep 28 18:27:00 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.413s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3842b93-53ff-4f11-a0af-a1105797f917 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-a723aa25-cc15-4cc3-b6e3-b02806b06a66-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl" returned: 1 in 0.441s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_t2v7zprl' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[86951e13-db19-4ce2-b427-5f5ac81a398d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-a9fca1f8-f451-48d4-b074-3b74f70944d7-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-74307b8e-48c5-4d67-ae20-cbff97e6f02f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-a9fca1f8-f451-48d4-b074-3b74f70944d7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-74307b8e-48c5-4d67-ae20-cbff97e6f02f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:01 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD Sep 28 18:27:01 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-a9fca1f8-f451-48d4-b074-3b74f70944d7" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "cinder-quobyte-74307b8e-48c5-4d67-ae20-cbff97e6f02f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-a9fca1f8-f451-48d4-b074-3b74f70944d7" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-74307b8e-48c5-4d67-ae20-cbff97e6f02f" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0d390-8b29-48d0-9d1c-cc1b788c177a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf79291-57c7-49be-871b-862729859ddc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 Sep 28 18:27:01 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f Sep 28 18:27:01 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 Sep 28 18:27:01 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7" returned: 0 in 0.443s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7 Sep 28 18:27:01 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f" returned: 0 in 0.513s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f Sep 28 18:27:01 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a9fca1f8-f451-48d4-b074-3b74f70944d7" returned: 0 in 0.377s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-a9fca1f8-f451-48d4-b074-3b74f70944d7" released by "delete_volume" :: held 0.920s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:02 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-74307b8e-48c5-4d67-ae20-cbff97e6f02f" returned: 0 in 0.355s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-quobyte-74307b8e-48c5-4d67-ae20-cbff97e6f02f" released by "delete_volume" :: held 0.949s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['be8c9f37-b98e-43e9-a0b3-8b6245e7295c', 'e3cefcde-035f-4085-9e7d-b26d887efe02', '845b40d7-5cf8-4ec9-93a9-5448f04f91b9', 'd0e89837-f840-4203-9ccd-e85ab54b5370'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Created reservations ['518ae263-1378-4a2f-bfb2-6854255217c7', '11190293-a95a-4a6d-ac47-25bc538ec31b', '7ade3a38-f263-4c85-a335-6afccead9d5e', '732abcf2-4253-494e-9062-635431758f15'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:02 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:02 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:02 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:02 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:02 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.328s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-2a4aa803-6439-448a-beb5-ecee0fa100db tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-a9fca1f8-f451-48d4-b074-3b74f70944d7-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:02 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Deleted volume successfully. Sep 28 18:27:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-fcb08513-db4b-4a53-9d3b-d76d53fea517 tempest-AttachVolumeNegativeTest-1323152625 None] Lock "cinder-74307b8e-48c5-4d67-ae20-cbff97e6f02f-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "cinder-quobyte-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2158ab92-5433-466a-b152-18950470e87c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:03 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa Sep 28 18:27:03 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" returned: 0 in 0.538s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:04 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83" returned: 0 in 2.687s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc7c376-3598-4d37-8a1d-9f8ad23fa742_obb2bgc6devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:27:04 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Converted 112.00 MB image at 41.66 MB/s Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:04 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa Sep 28 18:27:04 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1G Sep 28 18:27:04 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" returned: 0 in 0.341s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-quobyte-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa" released by "delete_volume" :: held 0.941s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:04 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 1G" returned: 0 in 0.379s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Downloaded image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}])) to volume bb404506-21c6-44cf-98db-d6bfcaa23e83 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Temporary image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 for user 3880285ebc2744a88bc5744ad7bbe9e1 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Marking volume bb404506-21c6-44cf-98db-d6bfcaa23e83 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Copying metadata from image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 to bb404506-21c6-44cf-98db-d6bfcaa23e83. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Creating volume glance metadata for volume bb404506-21c6-44cf-98db-d6bfcaa23e83 backed by image 4cc7c376-3598-4d37-8a1d-9f8ad23fa742 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Created reservations ['4f5b4b23-5e99-4f0a-b40b-48227ce9a9c6', 'af9577b1-6c3a-4e30-bc20-85b7fe845bbb', '4807e0e1-8f48-46de-8201-b0264ff09271', '9485c75d-3da5-45b9-ae78-3a250ea7ba29'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:04 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:04 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b8cfa-9acb-4955-b774-a4a483c938dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb404506-21c6-44cf-98db-d6bfcaa23e83', 'volume_size': 1, 'image_id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a544dddb52cc460e8db94a525adf6c42', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cc7c376-3598-4d37-8a1d-9f8ad23fa742', 'created_at': datetime.datetime(2026, 9, 28, 16, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc7c376-3598-4d37-8a1d-9f8ad23fa742/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566cb611-7242-4f8b-8c5e-27f71be9382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Volume volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 (bb404506-21c6-44cf-98db-d6bfcaa23e83): created successfully Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566cb611-7242-4f8b-8c5e-27f71be9382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Flow 'volume_create_manager' (6ba57a05-6a72-4079-a212-65ab2c6f0841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-53c23c10-d652-4b5a-b60f-f277b15ef457 tempest-TestShelveInstance-1203140826 None] Created volume successfully. Sep 28 18:27:04 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.292s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Deleted volume successfully. Sep 28 18:27:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f7c98f3-f3c1-4878-b2cb-448d9c86d1d0 tempest-CreateVolumesFromSourceVolumeTest-2094266955 None] Lock "cinder-1909abb2-5d10-48b5-be01-5ac9ad3bd7fa-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Flow 'volume_create_manager' (479d35b3-a42c-4df2-a559-867ec920d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3233f9-96d3-4d52-a67c-41b3d24a61f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3233f9-96d3-4d52-a67c-41b3d24a61f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099415608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b10d5-b110-46b0-b48b-a80f2740af5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512b017c56d542e480583ff69131c49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:06Z,use_quota=True,user_id='d9b4753e8ae64bdd907947d8b94709a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc7bbf6-6393-4af9-8e2a-db7a73b7fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc7bbf6-6393-4af9-8e2a-db7a73b7fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf7fffa-7d53-4614-a42a-cbc57cf99da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf7fffa-7d53-4614-a42a-cbc57cf99da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20b10d5-b110-46b0-b48b-a80f2740af5f', 'volume_name': 'volume-a20b10d5-b110-46b0-b48b-a80f2740af5f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad358d8c-f66c-4155-b089-43a2f5f0f827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad358d8c-f66c-4155-b089-43a2f5f0f827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926d9d69-72aa-4ca8-ba65-4f62fe94a656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Volume a20b10d5-b110-46b0-b48b-a80f2740af5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20b10d5-b110-46b0-b48b-a80f2740af5f', 'volume_size': 1} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099415608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b10d5-b110-46b0-b48b-a80f2740af5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512b017c56d542e480583ff69131c49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:06Z,use_quota=True,user_id='d9b4753e8ae64bdd907947d8b94709a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Creating volume a20b10d5-b110-46b0-b48b-a80f2740af5f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:06 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:06 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f 1073741824 Sep 28 18:27:06 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:06 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f 1073741824" returned: 0 in 0.612s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:06 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f Sep 28 18:27:06 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:07 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f" returned: 0 in 0.383s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926d9d69-72aa-4ca8-ba65-4f62fe94a656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20b10d5-b110-46b0-b48b-a80f2740af5f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200c031c-b283-4920-b4cb-2a55544fd3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:07 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Volume volume-a20b10d5-b110-46b0-b48b-a80f2740af5f (a20b10d5-b110-46b0-b48b-a80f2740af5f): created successfully Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200c031c-b283-4920-b4cb-2a55544fd3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Flow 'volume_create_manager' (479d35b3-a42c-4df2-a559-867ec920d470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:07 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-da28a5da-4ae4-4368-a067-28e81c014b65 tempest-ProjectReaderTests-1118503284 None] Created volume successfully. Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-173c4647-e291-4ed6-93b4-af900c541c4e req-904c6d53-56eb-4957-9762-74667c449b51 tempest-TestShelveInstance-1203140826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-173c4647-e291-4ed6-93b4-af900c541c4e req-904c6d53-56eb-4957-9762-74667c449b51 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Acquiring lock "cinder-a20b10d5-b110-46b0-b48b-a80f2740af5f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-173c4647-e291-4ed6-93b4-af900c541c4e req-904c6d53-56eb-4957-9762-74667c449b51 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "cinder-a20b10d5-b110-46b0-b48b-a80f2740af5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-173c4647-e291-4ed6-93b4-af900c541c4e req-904c6d53-56eb-4957-9762-74667c449b51 tempest-TestShelveInstance-1203140826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-bb404506-21c6-44cf-98db-d6bfcaa23e83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd631bb2c-939b-468b-980d-33efe95656ea', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Acquiring lock "cinder-quobyte-a20b10d5-b110-46b0-b48b-a80f2740af5f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "cinder-quobyte-a20b10d5-b110-46b0-b48b-a80f2740af5f" acquired by "delete_volume" :: waited 0.050s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5283b0a-87cf-407c-bcdd-1a6b6b0c0792]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-173c4647-e291-4ed6-93b4-af900c541c4e req-904c6d53-56eb-4957-9762-74667c449b51 tempest-TestShelveInstance-1203140826 None] attachment_update completed successfully. Sep 28 18:27:08 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f Sep 28 18:27:08 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:09 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f" returned: 0 in 0.686s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:09 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f Sep 28 18:27:09 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:09 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a20b10d5-b110-46b0-b48b-a80f2740af5f" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "cinder-quobyte-a20b10d5-b110-46b0-b48b-a80f2740af5f" released by "delete_volume" :: held 1.124s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Created reservations ['f5d22f7d-3241-4d92-a06c-05b097352d35', 'ef3594cc-0b8e-450c-a334-0b4d4ed10afb', 'a6de7da8-ff9a-4fce-a820-7baf30f29999', '279bfce3-310c-44a3-88cc-39b2fbb67ba1'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:10 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:10 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Flow 'volume_create_manager' (d8d3dcea-4cd0-47d7-8e5b-8ab392a3956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b9f0f-0367-471b-8602-35ac089ab2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b9f0f-0367-471b-8602-35ac089ab2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1183400801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc91366c-6788-44a0-92d7-885d054ade3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412d8421cd324b9e9fc360cd7c2a0b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:10Z,use_quota=True,user_id='fec33a840ebf423795733e6c1e90e3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f254672-b832-4a02-85c0-21fae88a8da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f254672-b832-4a02-85c0-21fae88a8da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877790e6-0666-4811-9dbf-8c738ac468a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877790e6-0666-4811-9dbf-8c738ac468a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc91366c-6788-44a0-92d7-885d054ade3c', 'volume_name': 'volume-bc91366c-6788-44a0-92d7-885d054ade3c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fba2593-10ef-474b-b8cc-3b68426c10e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fba2593-10ef-474b-b8cc-3b68426c10e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f853030f-e0f4-4432-b844-da80bd4fa962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Volume bc91366c-6788-44a0-92d7-885d054ade3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc91366c-6788-44a0-92d7-885d054ade3c', 'volume_size': 1} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1183400801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc91366c-6788-44a0-92d7-885d054ade3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412d8421cd324b9e9fc360cd7c2a0b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:10Z,use_quota=True,user_id='fec33a840ebf423795733e6c1e90e3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Creating volume bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:10 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:10 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c 1073741824 Sep 28 18:27:10 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:10 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Deleted volume successfully. Sep 28 18:27:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8e5a41fb-f980-4827-b796-649a0fa1ea9f tempest-ProjectReaderTests-1118503284 None] Lock "cinder-a20b10d5-b110-46b0-b48b-a80f2740af5f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:11 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c 1073741824" returned: 0 in 0.638s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:11 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:11 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:11 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.456s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f853030f-e0f4-4432-b844-da80bd4fa962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc91366c-6788-44a0-92d7-885d054ade3c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d0f031-3924-418e-830e-62e2c2427f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Volume volume-bc91366c-6788-44a0-92d7-885d054ade3c (bc91366c-6788-44a0-92d7-885d054ade3c): created successfully Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d0f031-3924-418e-830e-62e2c2427f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Flow 'volume_create_manager' (d8d3dcea-4cd0-47d7-8e5b-8ab392a3956f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-973a6ccf-6d68-467f-9770-80dc4a34e491 tempest-VolumeDependencyTests-1319866532 None] Created volume successfully. Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Flow 'volume_create_manager' (9488baf5-8b75-4f3f-bdc5-760da9205f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5d580a-bf01-4d58-b719-8aa0561897ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5d580a-bf01-4d58-b719-8aa0561897ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303896574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a148ce7-ad71-4d8b-b893-a6c6d53c92f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512b017c56d542e480583ff69131c49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:12Z,use_quota=True,user_id='d9b4753e8ae64bdd907947d8b94709a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23145220-7aa1-4f06-ae0c-40e37003fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23145220-7aa1-4f06-ae0c-40e37003fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406d6dda-c057-4bc0-91cf-428805c08536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406d6dda-c057-4bc0-91cf-428805c08536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a148ce7-ad71-4d8b-b893-a6c6d53c92f1', 'volume_name': 'volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd661d28-3a2e-47b2-aee8-bcb57bbc0e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd661d28-3a2e-47b2-aee8-bcb57bbc0e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd1f6ed-3a82-4125-bd1c-6a22d5bec0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:11 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Volume 4a148ce7-ad71-4d8b-b893-a6c6d53c92f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1', 'volume_size': 1} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303896574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a148ce7-ad71-4d8b-b893-a6c6d53c92f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512b017c56d542e480583ff69131c49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:12Z,use_quota=True,user_id='d9b4753e8ae64bdd907947d8b94709a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Creating volume 4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:11 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:11 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 1073741824 Sep 28 18:27:11 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:12 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 1073741824" returned: 0 in 0.808s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:12 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 Sep 28 18:27:12 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:13 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" returned: 0 in 0.496s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.428s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Creating offline snapshot 92d679e0-243c-4805-aa87-04b857f2e2d5 of volume bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd1f6ed-3a82-4125-bd1c-6a22d5bec0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4a7c3b-494a-40df-97bd-6519381c8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cc55b8-08e5-4576-800c-d84e8dfaf427]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:13 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Volume volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 (4a148ce7-ad71-4d8b-b893-a6c6d53c92f1): created successfully Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4a7c3b-494a-40df-97bd-6519381c8d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Flow 'volume_create_manager' (9488baf5-8b75-4f3f-bdc5-760da9205f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-035ff465-1c84-494e-806e-b1d7f113309b tempest-ProjectReaderTests-1118503284 None] Created volume successfully. Sep 28 18:27:13 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:13 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:13 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.578s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Acquiring lock "cinder-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:13 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 1G Sep 28 18:27:13 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "cinder-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Acquiring lock "cinder-quobyte-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "cinder-quobyte-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8d95b-8250-4741-9960-66de10b68320]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:14 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 Sep 28 18:27:14 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:14 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 1G" returned: 0 in 0.541s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc91366c-6788-44a0-92d7-885d054ade3c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:14 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc91366c-6788-44a0-92d7-885d054ade3c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:14 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:14 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" returned: 0 in 0.614s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:14 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1 Sep 28 18:27:14 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:14 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc91366c-6788-44a0-92d7-885d054ade3c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.488s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:14 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 is being set with open permissions: ugo+rw Sep 28 18:27:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:15 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:15 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:15 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" returned: 0 in 0.346s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "cinder-quobyte-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1" released by "delete_volume" :: held 1.027s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Created reservations ['4f6ff996-54c1-4d55-a688-c9ea155739c8', 'c9a25e46-e42e-4c74-b66a-c04938a30190', 'fc043e96-5b23-420c-9abe-f5a67fa074a5', 'c2b873a8-2d9b-47c6-ac5a-c20cda990962'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:15 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.386s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:15 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:15 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:15 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info Sep 28 18:27:15 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:15 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.369s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Deleted volume successfully. Sep 28 18:27:15 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:15 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info is being set with open permissions: ugo+rw Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c352e6e0-4ea7-4a61-aa5d-f3cd891fe748 tempest-ProjectReaderTests-1118503284 None] Lock "cinder-4a148ce7-ad71-4d8b-b893-a6c6d53c92f1-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:15 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info Sep 28 18:27:15 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:16 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.info" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.111s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d160be64-8646-4a5a-bf6c-8fe6ba1b59ec tempest-VolumeDependencyTests-1319866532 None] Create snapshot completed successfully Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Flow 'volume_create_manager' (e490c21e-9e8f-4a72-820e-b2947bbfb593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da508b-2882-44df-8b14-d4ad93205f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da508b-2882-44df-8b14-d4ad93205f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-779632229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d25352-775a-45c3-9a10-bbf0b8760351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529ae3edb1043669280f651ca545ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:17Z,use_quota=True,user_id='7b6c022db10a4433a738478ab7e9309d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13545ed-3ccf-4293-bb53-dc8f962693f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13545ed-3ccf-4293-bb53-dc8f962693f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b82235-1ada-4be0-a3d3-1249b3e7ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b82235-1ada-4be0-a3d3-1249b3e7ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d25352-775a-45c3-9a10-bbf0b8760351', 'volume_name': 'volume-c5d25352-775a-45c3-9a10-bbf0b8760351', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f6ffde-f69e-4a6a-87eb-5d93fac0f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f6ffde-f69e-4a6a-87eb-5d93fac0f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf362a0-70b7-49f9-b4e7-fc7bbfcb241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:16 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Volume c5d25352-775a-45c3-9a10-bbf0b8760351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d25352-775a-45c3-9a10-bbf0b8760351', 'volume_size': 1} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-779632229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d25352-775a-45c3-9a10-bbf0b8760351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529ae3edb1043669280f651ca545ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:17Z,use_quota=True,user_id='7b6c022db10a4433a738478ab7e9309d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Creating volume c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:16 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:16 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 1073741824 Sep 28 18:27:16 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:17 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 1073741824" returned: 0 in 0.612s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 Sep 28 18:27:17 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:18 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351" returned: 0 in 0.682s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf362a0-70b7-49f9-b4e7-fc7bbfcb241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d25352-775a-45c3-9a10-bbf0b8760351', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ec0581-41b9-4938-af23-5931ed90f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Volume volume-c5d25352-775a-45c3-9a10-bbf0b8760351 (c5d25352-775a-45c3-9a10-bbf0b8760351): created successfully Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ec0581-41b9-4938-af23-5931ed90f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Flow 'volume_create_manager' (e490c21e-9e8f-4a72-820e-b2947bbfb593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:18 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-886df066-236e-41c3-802e-3ba91b65e342 req-44eca58a-eff9-4c4a-b7e4-32cb90e189b6 tempest-VolumesSnapshotsTestJSON-1705458639 None] Created volume successfully. Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Flow 'volume_create_manager' (adeb0f15-f80f-4a3c-ae71-eb28de4b8801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623e7191-8897-4e1c-b7df-86ef456767d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623e7191-8897-4e1c-b7df-86ef456767d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1711206950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3c4342-da4e-4439-aa34-a3828e8b2e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412d8421cd324b9e9fc360cd7c2a0b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92d679e0-243c-4805-aa87-04b857f2e2d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:18Z,use_quota=True,user_id='fec33a840ebf423795733e6c1e90e3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdb992f-09ab-4b4e-913a-13fe43f34e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdb992f-09ab-4b4e-913a-13fe43f34e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5374415-4f82-42d5-b19e-f1795ca5e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5374415-4f82-42d5-b19e-f1795ca5e25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a3c4342-da4e-4439-aa34-a3828e8b2e69', 'volume_name': 'volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69', 'volume_size': 1, 'snapshot_id': '92d679e0-243c-4805-aa87-04b857f2e2d5'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1415ba7b-28fc-48f5-bb2b-e1210d02c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1415ba7b-28fc-48f5-bb2b-e1210d02c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06071548-8226-4729-b0b0-b0ec04d33eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:18 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Volume 8a3c4342-da4e-4439-aa34-a3828e8b2e69: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69', 'volume_size': 1, 'snapshot_id': '92d679e0-243c-4805-aa87-04b857f2e2d5'} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5-8a3c4342-da4e-4439-aa34-a3828e8b2e69" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5-8a3c4342-da4e-4439-aa34-a3828e8b2e69" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Creating volume 8a3c4342-da4e-4439-aa34-a3828e8b2e69 from snapshot 92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] snapshot: 92d679e0-243c-4805-aa87-04b857f2e2d5, volume: 8a3c4342-da4e-4439-aa34-a3828e8b2e69, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691122f-1eb3-42b7-af81-21f549818516]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:18 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:18 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:19 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.754s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc91366c-6788-44a0-92d7-885d054ade3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:19 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a1e8f-b688-40ba-a5b4-e77504a92a3c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:19 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:19 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:20 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.607s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:27:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:27:20 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:27:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:20 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 Sep 28 18:27:20 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (fb78a283-ee2b-4ec4-8d39-26a1f7e06ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86815048-b02b-4c01-828f-7815c6b1f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86815048-b02b-4c01-828f-7815c6b1f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303889474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7529df-8aed-4dbd-a7fd-27a03a199d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:26Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ced1a9-f250-4ba4-8ab9-27c8c4972a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ced1a9-f250-4ba4-8ab9-27c8c4972a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12143f-56a8-4818-b40d-f6ae147aa3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12143f-56a8-4818-b40d-f6ae147aa3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7529df-8aed-4dbd-a7fd-27a03a199d29', 'volume_name': 'volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24685007-55a4-4e25-9733-3219974a4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24685007-55a4-4e25-9733-3219974a4662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2619a4c8-8697-49fc-a805-588f1ba8893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Volume fa7529df-8aed-4dbd-a7fd-27a03a199d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29', 'volume_size': 1} Sep 28 18:27:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:29 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69" returned: 0 in 9.438s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:29 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:27:29 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Converted 1024.00 MB image at 108.48 MB/s Sep 28 18:27:29 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 is being set with open permissions: ugo+rw Sep 28 18:27:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:29 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 Sep 28 18:27:29 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:29 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69" returned: 0 in 0.274s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" released by "_copy_volume_from_snapshot" :: held 11.239s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5-8a3c4342-da4e-4439-aa34-a3828e8b2e69" released by "_create_volume_from_snapshot" :: held 11.327s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.347s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.285s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Creating offline snapshot 7f146e72-c15f-4332-9d7c-f78b8a11426e of volume c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06071548-8226-4729-b0b0-b0ec04d33eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69', 'volume_size': 1, 'snapshot_id': '92d679e0-243c-4805-aa87-04b857f2e2d5'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1241d-3198-49d6-9b83-3b29c19eb91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e458a-8d7e-4f31-83b2-816743a8bb3d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Volume volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 (8a3c4342-da4e-4439-aa34-a3828e8b2e69): created successfully Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1241d-3198-49d6-9b83-3b29c19eb91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Flow 'volume_create_manager' (adeb0f15-f80f-4a3c-ae71-eb28de4b8801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a289863b-82eb-46ac-bcb0-95dd1d627dcf tempest-VolumeDependencyTests-1319866532 None] Created volume successfully. Sep 28 18:27:30 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 Sep 28 18:27:30 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e 1G Sep 28 18:27:30 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e 1G" returned: 0 in 0.407s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d25352-775a-45c3-9a10-bbf0b8760351 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d25352-775a-45c3-9a10-bbf0b8760351 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e Sep 28 18:27:30 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-92d679e0-243c-4805-aa87-04b857f2e2d5-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-92d679e0-243c-4805-aa87-04b857f2e2d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Deleting offline snapshot 92d679e0-243c-4805-aa87-04b857f2e2d5 of volume bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] snapshot_file for this snap is: volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[39596599-54a9-43d8-8fa5-b748921b865f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d25352-775a-45c3-9a10-bbf0b8760351 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e is being set with open permissions: ugo+rw Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e Sep 28 18:27:31 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:31 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info Sep 28 18:27:31 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc91366c-6788-44a0-92d7-885d054ade3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8c876-4f22-4f92-b1c5-3713dad83ec9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:31 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info is being set with open permissions: ugo+rw Sep 28 18:27:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info Sep 28 18:27:31 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.info" returned: 0 in 0.295s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.683s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303889474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7529df-8aed-4dbd-a7fd-27a03a199d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:26Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Creating volume fa7529df-8aed-4dbd-a7fd-27a03a199d29 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:32 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 1073741824 Sep 28 18:27:32 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-d9f84a97-cec8-4111-b1cc-82c69650bc1a req-1802f441-85ab-4ccc-9cae-7a0fe1d1c3ef tempest-VolumesSnapshotsTestJSON-1705458639 None] Create snapshot completed successfully Sep 28 18:27:32 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.698s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:32 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 1073741824" returned: 0 in 0.514s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 Sep 28 18:27:32 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.477s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5 Sep 28 18:27:32 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:33 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29" returned: 0 in 0.293s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2619a4c8-8697-49fc-a805-588f1ba8893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f424bf-4ca7-4452-9c1a-750b050cdee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:33 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Volume volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 (fa7529df-8aed-4dbd-a7fd-27a03a199d29): created successfully Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f424bf-4ca7-4452-9c1a-750b050cdee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (fb78a283-ee2b-4ec4-8d39-26a1f7e06ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:33 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c.92d679e0-243c-4805-aa87-04b857f2e2d5" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b3ccf574-fc0f-4f6f-b8b8-d69c81af43dd tempest-ProjectReaderTests-709047538 None] Created volume successfully. Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-92d679e0-243c-4805-aa87-04b857f2e2d5" released by "_delete_snapshot" :: held 2.093s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" released by "delete_snapshot" :: held 2.123s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Created reservations ['dfe32ff6-8c37-4a3a-aaf4-988d43f0d77f', 'd498bfd7-96f8-488d-a4b4-d42ad9451e2d', 'be577b1c-5de1-4227-8a2b-4eab2ac1e357', '18ed94fa-ce0f-4b6f-807f-4d5f6bf46572'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "cinder-7f146e72-c15f-4332-9d7c-f78b8a11426e-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-7f146e72-c15f-4332-9d7c-f78b8a11426e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "cinder-quobyte-7f146e72-c15f-4332-9d7c-f78b8a11426e" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Delete snapshot completed successfully. Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-7f146e72-c15f-4332-9d7c-f78b8a11426e" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Deleting offline snapshot 7f146e72-c15f-4332-9d7c-f78b8a11426e of volume c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] snapshot_file for this snap is: volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-84d855ab-ad0a-451b-98f7-0232e74c7bac tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-92d679e0-243c-4805-aa87-04b857f2e2d5-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fbd939-0557-4f9b-b967-a1aeb0c151c3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:33 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e Sep 28 18:27:33 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-fa7529df-8aed-4dbd-a7fd-27a03a199d29-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "cinder-fa7529df-8aed-4dbd-a7fd-27a03a199d29-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-quobyte-fa7529df-8aed-4dbd-a7fd-27a03a199d29" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-fa7529df-8aed-4dbd-a7fd-27a03a199d29" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30477643-b8a1-425d-8cf4-814a7fe8f195]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e" returned: 0 in 0.536s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5d25352-775a-45c3-9a10-bbf0b8760351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:34 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 Sep 28 18:27:34 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e16ff-3742-4e03-ab5f-06182bdc8de1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 Sep 28 18:27:34 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-bc91366c-6788-44a0-92d7-885d054ade3c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-bc91366c-6788-44a0-92d7-885d054ade3c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:34 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29" returned: 0 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" acquired by "delete_volume" :: waited 0.044s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:34 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29 Sep 28 18:27:34 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b66ca-dcc6-4468-a7d6-b91306a22bc5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351" returned: 0 in 0.535s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:34 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e Sep 28 18:27:34 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-fa7529df-8aed-4dbd-a7fd-27a03a199d29" returned: 0 in 0.382s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-fa7529df-8aed-4dbd-a7fd-27a03a199d29" released by "delete_volume" :: held 0.955s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Created reservations ['95e5a561-d607-4dac-a623-7e17c2e28574', '55067c21-8ec5-4c4f-a783-b86531d7f967', '3f160508-8462-41df-9594-2a57775504c7', 'bfac9717-cf6f-4ee4-8992-5c1f459064b8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:35 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.581s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c Sep 28 18:27:35 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e" returned: 0 in 0.550s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e Sep 28 18:27:35 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.312s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Deleted volume successfully. Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-22efb4bd-75bc-4616-a91c-4644c925c91c tempest-ProjectReaderTests-709047538 None] Lock "cinder-fa7529df-8aed-4dbd-a7fd-27a03a199d29-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bc91366c-6788-44a0-92d7-885d054ade3c" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-bc91366c-6788-44a0-92d7-885d054ade3c" released by "delete_volume" :: held 1.076s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351.7f146e72-c15f-4332-9d7c-f78b8a11426e" returned: 0 in 0.379s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-7f146e72-c15f-4332-9d7c-f78b8a11426e" released by "_delete_snapshot" :: held 2.175s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" released by "delete_snapshot" :: held 2.245s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Created reservations ['4a0549ef-3ad4-4862-a44a-7adf5f40a4e7', 'ec3829e2-16bc-476e-a811-59884491695d', '3857601b-cea5-4645-a3e8-837b3f190b63', '007a6dac-026b-4a4a-8d72-10d26341800a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.quota [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Created reservations ['7d9aa229-8165-41c7-bce7-eb1932a225d8', '07885d34-249f-4633-96b6-1a5fc2566887', 'd9d335bf-df36-43db-bcb1-efe61d19e0cf', '4502130d-0b8b-4aab-b570-6f50f6c2c671'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:35 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Delete snapshot completed successfully. Sep 28 18:27:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-c438c4ef-ce81-473f-ab98-5264ed4bf570 req-14b1b14f-6878-44a5-8690-ddf0a6dfa83a tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-7f146e72-c15f-4332-9d7c-f78b8a11426e-delete_snapshot" released by "delete_snapshot" :: held 2.526s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:36 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Deleted volume successfully. Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0b981af7-83b4-41ce-8fe4-65ada5fc09c4 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-bc91366c-6788-44a0-92d7-885d054ade3c-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (c3aacbde-899f-46e7-b024-9b53235316dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bf9ba9-ec7d-4969-9c6e-df344e795dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bf9ba9-ec7d-4969-9c6e-df344e795dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964726176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d1dda7-9d4f-4092-8da1-1b6891d17949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:37Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8ca45e-0923-4f7e-ad52-2c18bcf5043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8ca45e-0923-4f7e-ad52-2c18bcf5043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833f60b6-7772-441a-b9f1-b2dab90c3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833f60b6-7772-441a-b9f1-b2dab90c3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d1dda7-9d4f-4092-8da1-1b6891d17949', 'volume_name': 'volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e84cd9-4b62-48c1-937f-45e60eb0bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e84cd9-4b62-48c1-937f-45e60eb0bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82b140-8b25-4af0-82e0-1d8451cebe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Volume c3d1dda7-9d4f-4092-8da1-1b6891d17949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949', 'volume_size': 1} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964726176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d1dda7-9d4f-4092-8da1-1b6891d17949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:37Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Creating volume c3d1dda7-9d4f-4092-8da1-1b6891d17949 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:36 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-8a3c4342-da4e-4439-aa34-a3828e8b2e69-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "cinder-c5d25352-775a-45c3-9a10-bbf0b8760351-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:36 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 1073741824 Sep 28 18:27:36 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-8a3c4342-da4e-4439-aa34-a3828e8b2e69-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-c5d25352-775a-45c3-9a10-bbf0b8760351-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" acquired by "delete_volume" :: waited 0.040s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2724570-3389-4337-81a7-deb72b742836]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5d89d6-159c-439a-aa7b-c31112cf4f10]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 Sep 28 18:27:37 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 Sep 28 18:27:37 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 1073741824" returned: 0 in 0.548s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 Sep 28 18:27:37 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351" returned: 0 in 0.448s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69 Sep 28 18:27:37 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351 Sep 28 18:27:37 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949" returned: 0 in 0.294s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82b140-8b25-4af0-82e0-1d8451cebe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e8f093-a7a5-4352-8ec3-6d1ce6e379b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8a3c4342-da4e-4439-aa34-a3828e8b2e69" returned: 0 in 0.270s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Volume volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 (c3d1dda7-9d4f-4092-8da1-1b6891d17949): created successfully Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e8f093-a7a5-4352-8ec3-6d1ce6e379b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (c3aacbde-899f-46e7-b024-9b53235316dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-quobyte-8a3c4342-da4e-4439-aa34-a3828e8b2e69" released by "delete_volume" :: held 0.804s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:37 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c5d25352-775a-45c3-9a10-bbf0b8760351" returned: 0 in 0.293s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0d432e49-d388-4fdd-b465-2edcaeadb914 tempest-ProjectReaderTests-709047538 None] Created volume successfully. Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-quobyte-c5d25352-775a-45c3-9a10-bbf0b8760351" released by "delete_volume" :: held 0.814s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Created reservations ['891385f1-7ecd-40cd-a158-04e1dd38ff69', '96df2bf7-5873-42c8-ac0a-4eae5145e18b', 'ea4e1536-869d-4013-bc34-bb0cd452adb2', '16195173-bd99-4037-97ce-6741647a9479'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.quota [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Created reservations ['2ac3bdf1-cf35-4e6b-9411-88f896023efe', '443c2ff6-3775-4c9e-a281-1e759392bcb1', '3b89df3e-8c1b-433f-b0c7-f1d074f899a7', 'af98c38a-23cc-492c-b178-7e3825be9d9c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:38 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:38 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.320s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:38 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Deleted volume successfully. Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=143,cinder:UPDATE=188,cinder:INSERT=47,cinder:DELETE=17 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5a3866d8-a224-4113-8c39-2e926b4f7e30 tempest-VolumeDependencyTests-1319866532 None] Lock "cinder-8a3c4342-da4e-4439-aa34-a3828e8b2e69-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:38 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.375s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.manager [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:38 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Deleted volume successfully. Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-d732c5a5-02c5-42c2-96fa-dac4bc984a8f req-b6a93b1b-7ea3-4d57-af3b-37c1607a0f48 tempest-VolumesSnapshotsTestJSON-1705458639 None] Lock "cinder-c5d25352-775a-45c3-9a10-bbf0b8760351-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-c3d1dda7-9d4f-4092-8da1-1b6891d17949-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "cinder-c3d1dda7-9d4f-4092-8da1-1b6891d17949-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=154,cinder:UPDATE=190,cinder:INSERT=54,cinder:DELETE=15 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-quobyte-c3d1dda7-9d4f-4092-8da1-1b6891d17949" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-c3d1dda7-9d4f-4092-8da1-1b6891d17949" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b12c2-355f-4f7d-89c1-ced9d24d1cc8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:39 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 Sep 28 18:27:39 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949" returned: 0 in 0.609s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:39 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949 Sep 28 18:27:39 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c3d1dda7-9d4f-4092-8da1-1b6891d17949" returned: 0 in 0.333s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-c3d1dda7-9d4f-4092-8da1-1b6891d17949" released by "delete_volume" :: held 1.027s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Created reservations ['d31cb392-e66c-465f-b3df-5892e40c1bae', 'c8cfd966-ed2d-4b4a-80b5-9999b687260e', '98ef0d07-bdb4-4b85-8a9b-0e72a0809d67', 'eddc6809-26f1-4d8a-b464-238551455420'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:40 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:40 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:40 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.338s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Deleted volume successfully. Sep 28 18:27:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9f8fcf46-0616-44f2-a0d7-39defc8304d4 tempest-ProjectReaderTests-709047538 None] Lock "cinder-c3d1dda7-9d4f-4092-8da1-1b6891d17949-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (4af6bd6f-334a-48dd-bb31-47cdd523acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5050d-392b-4cac-8e78-ff089845d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5050d-392b-4cac-8e78-ff089845d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056861531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:42Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bce76-9d01-4dd1-8646-09e41864b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bce76-9d01-4dd1-8646-09e41864b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ad22d-3543-4730-87b8-e4f9f9b488e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ad22d-3543-4730-87b8-e4f9f9b488e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b', 'volume_name': 'volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d44c820-6469-42f8-a79c-5d3599fcc807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d44c820-6469-42f8-a79c-5d3599fcc807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c8790-fb43-43bb-8ac6-fdccb8de5261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Volume ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b', 'volume_size': 1} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056861531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:42Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Creating volume ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b 1073741824 Sep 28 18:27:42 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b 1073741824" returned: 0 in 0.614s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b Sep 28 18:27:42 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" returned: 0 in 0.316s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c8790-fb43-43bb-8ac6-fdccb8de5261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f030735-edae-41d9-9c34-b8a0c6f62e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Volume volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b (ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b): created successfully Sep 28 18:27:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f030735-edae-41d9-9c34-b8a0c6f62e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (4af6bd6f-334a-48dd-bb31-47cdd523acbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7a201398-dfb7-4d4f-bd28-e871977448e6 tempest-ProjectReaderTests-709047538 None] Created volume successfully. Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "cinder-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c97cc567-cb0f-4446-9de3-e0df3d88fb2b tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-131020453: creating Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-quobyte-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c97cc567-cb0f-4446-9de3-e0df3d88fb2b tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-131020453: created successfully Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c97cc567-cb0f-4446-9de3-e0df3d88fb2b tempest-GroupSnapshotsTest-2112396151 None] Create group completed successfully. Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e17203-048a-447d-a873-3e26038b4273]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:44 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b Sep 28 18:27:44 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:44 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" returned: 0 in 0.461s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:44 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b Sep 28 18:27:44 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:45 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" returned: 0 in 0.296s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b" released by "delete_volume" :: held 0.828s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Created reservations ['09144d35-852d-487a-819f-fc272461ab19', 'c1f588bb-a1f8-49a7-936d-b4c81db446c1', '0e309cd0-4599-4d6d-9f4a-4a3f08018ef0', '24a4efd0-5636-4a17-9c86-c8ace8e72166'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:45 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:45 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:45 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.292s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Deleted volume successfully. Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-744ea39c-f1a5-4d75-9b86-f488a50e9508 tempest-ProjectReaderTests-709047538 None] Lock "cinder-ec7e1f3c-3b7d-4569-a7f6-2cf0ff5add6b-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (ea630326-9d0c-47dd-9c58-6807e16f99b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf512f43-8291-4d1b-b6d0-70f5055d97f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf512f43-8291-4d1b-b6d0-70f5055d97f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217516802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8cc1ec8-c250-4eef-95c5-70a04ad7ba0a,host='devstack@QuobyteHD#QuobyteHD',id=5415a243-a266-486c-8bdd-0f5e96d5edaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:46Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa2b388d-ae6c-47f3-b233-0180bfb4780e),volume_type_id=aa2b388d-ae6c-47f3-b233-0180bfb4780e)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2e2e93-4cc4-4e85-a6f6-48ba48e77d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2e2e93-4cc4-4e85-a6f6-48ba48e77d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39f2c0d-d18f-45e2-bdf6-de61afb994a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:45 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39f2c0d-d18f-45e2-bdf6-de61afb994a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5415a243-a266-486c-8bdd-0f5e96d5edaf', 'volume_name': 'volume-5415a243-a266-486c-8bdd-0f5e96d5edaf', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236ab84-7027-4af1-93b0-7fccab45341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236ab84-7027-4af1-93b0-7fccab45341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d45b45-b540-46fb-85f0-971665502efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Volume 5415a243-a266-486c-8bdd-0f5e96d5edaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5415a243-a266-486c-8bdd-0f5e96d5edaf', 'volume_size': 1} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8cc1ec8-c250-4eef-95c5-70a04ad7ba0a,created_at=2026-09-28T16:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217516802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8cc1ec8-c250-4eef-95c5-70a04ad7ba0a,host='devstack@QuobyteHD#QuobyteHD',id=5415a243-a266-486c-8bdd-0f5e96d5edaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:46Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa2b388d-ae6c-47f3-b233-0180bfb4780e),volume_type_id=aa2b388d-ae6c-47f3-b233-0180bfb4780e)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Creating volume 5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:46 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf 1073741824 Sep 28 18:27:46 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Flow 'volume_create_manager' (d712ebe1-bcce-4d7a-9dc8-66c9a366a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459e0974-9561-4b87-90f4-1d8ef6a1c1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459e0974-9561-4b87-90f4-1d8ef6a1c1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da7eab-93ad-4406-9bec-e498dd8b800f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0edff12d7b84d0a9f9c5aa4b05afebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:46Z,use_quota=True,user_id='799a5e0edb1f46bb9d6f7530563f41f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e39a425-4f3a-4203-98ba-980a1bb1b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e39a425-4f3a-4203-98ba-980a1bb1b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a0c9e-142d-46af-ac16-cda8db43841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (c6fc9a55-48ea-434e-95f5-6c1c971a8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b21fc8-b252-4655-a21a-f8336cc96dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b21fc8-b252-4655-a21a-f8336cc96dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961212018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63894b7c-ba5d-4a0d-bbc0-41ec24adc938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:47Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999b077e-6643-4afe-b920-40a232c1372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999b077e-6643-4afe-b920-40a232c1372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae00d43-0eb2-494d-823a-02f9721f2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae00d43-0eb2-494d-823a-02f9721f2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63894b7c-ba5d-4a0d-bbc0-41ec24adc938', 'volume_name': 'volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b4be83-3d09-4b59-8e82-905ac5cc6e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b4be83-3d09-4b59-8e82-905ac5cc6e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c1a410-39ca-4ea9-a57f-34acd95b58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Volume 63894b7c-ba5d-4a0d-bbc0-41ec24adc938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938', 'volume_size': 1} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:46 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf 1073741824" returned: 0 in 0.783s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:46 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:27:46 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a0c9e-142d-46af-ac16-cda8db43841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05da7eab-93ad-4406-9bec-e498dd8b800f', 'volume_name': 'volume-05da7eab-93ad-4406-9bec-e498dd8b800f', 'volume_size': 1, 'image_id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e7226ed9aa78b02db8f82a9dc329401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0edff12d7b84d0a9f9c5aa4b05afebb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3bca1f3936eb086d6712d9d247491802412426e6960fd90edc3534389e657953fff61be6231b33ad595b7ca85d487c7811a35e5a704093f189a5d1bde4f8f12', 'id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79175212-d8e4-4c81-8c9e-412c325e5195/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ebf40f-0944-447d-b454-35c8de21a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ebf40f-0944-447d-b454-35c8de21a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb30674-8ec6-46d7-8202-960d2a73ca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Volume 05da7eab-93ad-4406-9bec-e498dd8b800f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05da7eab-93ad-4406-9bec-e498dd8b800f', 'volume_size': 1, 'image_id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e7226ed9aa78b02db8f82a9dc329401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0edff12d7b84d0a9f9c5aa4b05afebb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3bca1f3936eb086d6712d9d247491802412426e6960fd90edc3534389e657953fff61be6231b33ad595b7ca85d487c7811a35e5a704093f189a5d1bde4f8f12', 'id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79175212-d8e4-4c81-8c9e-412c325e5195/file', 'properties': {}}, 'image_service': } Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Trying to clone 05da7eab-93ad-4406-9bec-e498dd8b800f from image 79175212-d8e4-4c81-8c9e-412c325e5195 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:27:47 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961212018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63894b7c-ba5d-4a0d-bbc0-41ec24adc938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4507700d8c448c6b81f67247688c1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:47Z,use_quota=True,user_id='4b015aeb3e094462a9fc2a5fbd344994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Creating volume 63894b7c-ba5d-4a0d-bbc0-41ec24adc938 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:47 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:27:47 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:27:47 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 1073741824 Sep 28 18:27:47 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d45b45-b540-46fb-85f0-971665502efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5415a243-a266-486c-8bdd-0f5e96d5edaf', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad78837-4514-4b10-a0d5-074c60fc20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Volume volume-5415a243-a266-486c-8bdd-0f5e96d5edaf (5415a243-a266-486c-8bdd-0f5e96d5edaf): created successfully Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad78837-4514-4b10-a0d5-074c60fc20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (ea630326-9d0c-47dd-9c58-6807e16f99b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47bee1-0975-409a-957d-5afe7500a627]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-374bbbf2-69d1-4c47-9378-146295de898c tempest-GroupSnapshotsTest-2112396151 None] Created volume successfully. Sep 28 18:27:47 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:47 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:47 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:47 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 1073741824" returned: 0 in 0.736s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:48 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 Sep 28 18:27:48 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:48 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:48 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:48 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:48 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Temporary image 79175212-d8e4-4c81-8c9e-412c325e5195 is fetched for user 799a5e0edb1f46bb9d6f7530563f41f9. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" returned: 0 in 0.330s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c1a410-39ca-4ea9-a57f-34acd95b58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3d8a4d-910a-4492-bbd1-6ff55c054da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Volume volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 (63894b7c-ba5d-4a0d-bbc0-41ec24adc938): created successfully Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3d8a4d-910a-4492-bbd1-6ff55c054da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Flow 'volume_create_manager' (c6fc9a55-48ea-434e-95f5-6c1c971a8795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-49c44411-07db-4ccd-9859-0e367293aaeb tempest-ProjectReaderTests-709047538 None] Created volume successfully. Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf110f1-8e8d-4f8a-9b31-51a88d4f2e58]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:48 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:48 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-63894b7c-ba5d-4a0d-bbc0-41ec24adc938-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "cinder-63894b7c-ba5d-4a0d-bbc0-41ec24adc938-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Acquiring lock "cinder-quobyte-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:48 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2302797-fe9d-4d93-ae5d-fb2e59fdbc7d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:49 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:49 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] GroupSnapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: creating. Sep 28 18:27:49 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 Sep 28 18:27:49 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Group snapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: creating. {{(pid=86560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Creating offline snapshot b8208b91-20bc-4353-b660-110d4b5dd46e of volume 5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35299a4-ed8b-4b19-82ff-00bd06b9713a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:49 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 1 in 0.563s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:49 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" returned: 0 in 0.738s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:49 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:27:49 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:49 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938 Sep 28 18:27:49 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-621155e6-bdbd-4808-8874-ddf8d0cba91f req-c4330072-be4e-4db8-83ec-fd244a4123fd tempest-TestShelveInstance-1203140826 None] Terminate volume connection completed successfully. Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-621155e6-bdbd-4808-8874-ddf8d0cba91f req-c4330072-be4e-4db8-83ec-fd244a4123fd tempest-TestShelveInstance-1203140826 None] Deleting attachment d631bb2c-939b-468b-980d-33efe95656ea. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:27:50 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" returned: 0 in 0.352s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "cinder-quobyte-63894b7c-ba5d-4a0d-bbc0-41ec24adc938" released by "delete_volume" :: held 1.184s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.798s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e 1G Sep 28 18:27:50 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Created reservations ['97b3d1ae-f03a-4a52-9f68-48c3dad873ef', 'e67d73cc-1750-4b43-8344-d184b189de87', '77d4ecf5-6b19-4567-bbe5-dfff5aba0ea5', '1cc8d59b-ad48-4eae-8618-39cf204205ad'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:27:50 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.317s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Deleted volume successfully. Sep 28 18:27:50 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c3f11981-17ab-4b87-a77d-20065bdb4022 tempest-ProjectReaderTests-709047538 None] Lock "cinder-63894b7c-ba5d-4a0d-bbc0-41ec24adc938-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e 1G" returned: 0 in 0.541s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5415a243-a266-486c-8bdd-0f5e96d5edaf -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5415a243-a266-486c-8bdd-0f5e96d5edaf -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:27:50 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5415a243-a266-486c-8bdd-0f5e96d5edaf -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.309s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:27:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:27:50 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.316s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:51 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info Sep 28 18:27:51 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:51 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:27:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:51 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info Sep 28 18:27:51 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.info" returned: 0 in 0.323s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da7eab-93ad-4406-9bec-e498dd8b800f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0edff12d7b84d0a9f9c5aa4b05afebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:46Z,use_quota=True,user_id='799a5e0edb1f46bb9d6f7530563f41f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Creating volume 05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:52 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:52 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1073741824 Sep 28 18:27:52 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:52 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c8944683-1bbe-407f-8012-cdf55bdf4d85 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: created successfully Sep 28 18:27:52 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1073741824" returned: 0 in 0.638s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:52 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f Sep 28 18:27:52 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Attempting download of 79175212-d8e4-4c81-8c9e-412c325e5195 ((None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}])) to volume 05da7eab-93ad-4406-9bec-e498dd8b800f. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6cfbf-0604-4395-b19e-a360524b58bf]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v Sep 28 18:27:53 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e-07fc3633-225a-41d5-acd5-1752990b8f02" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e-07fc3633-225a-41d5-acd5-1752990b8f02" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Creating volume 07fc3633-225a-41d5-acd5-1752990b8f02 from snapshot b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] snapshot: b8208b91-20bc-4353-b660-110d4b5dd46e, volume: 07fc3633-225a-41d5-acd5-1752990b8f02, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2862ca-6afd-4a70-9b3a-06ba0c0b77c7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v" returned: 0 in 0.519s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-17ce7c81-543b-449c-8f46-6e58a55bcb58 req-5cb9eafa-bd08-4503-b4c8-bc1489fabed2 tempest-TestShelveInstance-1203140826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:54 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:27:54 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v Sep 28 18:27:54 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v" returned: 1 in 0.477s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79175212-d8e4-4c81-8c9e-412c325e5195_wfzhm41v' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa18e20f-2878-4ac9-83e4-27f23b8bb918]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.644s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5415a243-a266-486c-8bdd-0f5e96d5edaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48555cd-2840-4a98-9d12-450e69936ef9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:54 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:27:54 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.432s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:27:54 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD Sep 28 18:27:54 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:27:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 Sep 28 18:27:54 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:55 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:55 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] 79175212-d8e4-4c81-8c9e-412c325e5195 was raw, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:27:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:55 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f Sep 28 18:27:55 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:56 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f" returned: 0 in 0.887s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79175212-d8e4-4c81-8c9e-412c325e5195_yp_krm60devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:27:56 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:56 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1G Sep 28 18:27:56 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:56 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f 1G" returned: 0 in 0.607s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Downloaded image 79175212-d8e4-4c81-8c9e-412c325e5195 ((None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}])) to volume 05da7eab-93ad-4406-9bec-e498dd8b800f successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Temporary image 79175212-d8e4-4c81-8c9e-412c325e5195 for user 799a5e0edb1f46bb9d6f7530563f41f9 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Marking volume 05da7eab-93ad-4406-9bec-e498dd8b800f as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Copying metadata from image 79175212-d8e4-4c81-8c9e-412c325e5195 to 05da7eab-93ad-4406-9bec-e498dd8b800f. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:27:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Creating volume glance metadata for volume 05da7eab-93ad-4406-9bec-e498dd8b800f backed by image 79175212-d8e4-4c81-8c9e-412c325e5195 with: {'image_id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6e7226ed9aa78b02db8f82a9dc329401', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:27:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb30674-8ec6-46d7-8202-960d2a73ca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05da7eab-93ad-4406-9bec-e498dd8b800f', 'volume_size': 1, 'image_id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79175212-d8e4-4c81-8c9e-412c325e5195', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e7226ed9aa78b02db8f82a9dc329401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0edff12d7b84d0a9f9c5aa4b05afebb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3bca1f3936eb086d6712d9d247491802412426e6960fd90edc3534389e657953fff61be6231b33ad595b7ca85d487c7811a35e5a704093f189a5d1bde4f8f12', 'id': '79175212-d8e4-4c81-8c9e-412c325e5195', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79175212-d8e4-4c81-8c9e-412c325e5195/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de7631f-b7a9-4515-ac95-976ffd2ab3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Volume volume-05da7eab-93ad-4406-9bec-e498dd8b800f (05da7eab-93ad-4406-9bec-e498dd8b800f): created successfully Sep 28 18:27:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de7631f-b7a9-4515-ac95-976ffd2ab3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Flow 'volume_create_manager' (d712ebe1-bcce-4d7a-9dc8-66c9a366a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-32bb26a6-4f25-4f18-beb3-2991a6e70d01 tempest-VolumeImageDependencyTests-525449740 None] Created volume successfully. Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:00 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:00 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:00 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.405s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Acquiring lock "cinder-05da7eab-93ad-4406-9bec-e498dd8b800f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "cinder-05da7eab-93ad-4406-9bec-e498dd8b800f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Acquiring lock "cinder-quobyte-05da7eab-93ad-4406-9bec-e498dd8b800f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "cinder-quobyte-05da7eab-93ad-4406-9bec-e498dd8b800f" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98bb9e4-223a-483f-9d5d-01ac3a87b7af]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f Sep 28 18:28:01 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02" returned: 0 in 6.643s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:01 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Converted 1024.00 MB image at 154.13 MB/s Sep 28 18:28:01 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 Sep 28 18:28:01 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f" returned: 0 in 0.560s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f Sep 28 18:28:01 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" released by "_copy_volume_from_snapshot" :: held 8.132s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e-07fc3633-225a-41d5-acd5-1752990b8f02" released by "_create_volume_from_snapshot" :: held 8.217s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.250s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-17ce7c81-543b-449c-8f46-6e58a55bcb58 req-5cb9eafa-bd08-4503-b4c8-bc1489fabed2 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.824s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-17ce7c81-543b-449c-8f46-6e58a55bcb58 req-5cb9eafa-bd08-4503-b4c8-bc1489fabed2 tempest-TestShelveInstance-1203140826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-17ce7c81-543b-449c-8f46-6e58a55bcb58 req-5cb9eafa-bd08-4503-b4c8-bc1489fabed2 tempest-TestShelveInstance-1203140826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-bb404506-21c6-44cf-98db-d6bfcaa23e83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '199eba85-61a5-4d5e-81f7-023388c64edf', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:28:01 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-05da7eab-93ad-4406-9bec-e498dd8b800f" returned: 0 in 0.266s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "cinder-quobyte-05da7eab-93ad-4406-9bec-e498dd8b800f" released by "delete_volume" :: held 0.912s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bfe8a142-e2d5-4468-b9ae-d4341ab1554a tempest-GroupSnapshotsTest-2112396151 None] Create group from source-snapshot-f813da88-ee35-4f41-a03c-18ab8593a6e5 completed successfully. Sep 28 18:28:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-17ce7c81-543b-449c-8f46-6e58a55bcb58 req-5cb9eafa-bd08-4503-b4c8-bc1489fabed2 tempest-TestShelveInstance-1203140826 None] attachment_update completed successfully. Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Created reservations ['043960bc-70b6-4652-8a7c-43f43500bc3e', '827f7e06-46b3-4fbd-ae33-c9ecc171fa93', 'b4fa85ac-f807-49af-acd4-36763561e17e', '4f9dbc3b-5507-4ead-9d10-2c5567f643cd'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:02 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:02 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:02 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Deleted volume successfully. Sep 28 18:28:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a5f13392-628a-4c28-88af-fdc737e73494 tempest-VolumeImageDependencyTests-525449740 None] Lock "cinder-05da7eab-93ad-4406-9bec-e498dd8b800f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335345b-325f-4054-bc18-2e7966ebe93a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:03 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 Sep 28 18:28:03 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:03 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02" returned: 0 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:03 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02 Sep 28 18:28:03 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:03 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-07fc3633-225a-41d5-acd5-1752990b8f02" returned: 0 in 0.350s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-07fc3633-225a-41d5-acd5-1752990b8f02" released by "delete_volume" :: held 0.836s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['9e3563f9-9ef1-4fc9-b1c4-c0b48b17c37d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:04 devstack cinder-volume[86560]: WARNING cinder.quota [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2095881982 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2095881982, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:04 devstack cinder-volume[86560]: WARNING cinder.quota [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2095881982 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2095881982, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['93dc02b6-bf93-45ff-a310-f362d527af22', 'dbf3a24a-e1d4-4063-a6b0-f0b8a567b8e1', 'edb92517-5a3e-4eab-a482-48fe563bcbbf', '76d4c08b-ac1d-49b2-85bf-6a5e09e9385f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:04 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:04 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: deleting Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: deleting {{(pid=86560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Deleting offline snapshot b8208b91-20bc-4353-b660-110d4b5dd46e of volume 5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:04 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] snapshot_file for this snap is: volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.492s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-42c21b21-229c-416f-b488-fe06d5c85e11 tempest-GroupSnapshotsTest-2112396151 None] Delete group completed successfully. Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2793e7dc-deb2-4f5d-90fc-4f2f8a0bcbc2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:04 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:28:04 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:05 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.462s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5415a243-a266-486c-8bdd-0f5e96d5edaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[679207a4-866e-4d35-b595-7d5136dc113c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:05 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:28:05 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:06 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.928s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:06 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:28:06 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:06 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.482s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:06 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e Sep 28 18:28:06 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:06 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf.b8208b91-20bc-4353-b660-110d4b5dd46e" returned: 0 in 0.294s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-b8208b91-20bc-4353-b660-110d4b5dd46e" released by "_delete_snapshot" :: held 2.341s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" released by "delete_snapshot" :: held 2.382s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:07 devstack cinder-volume[86560]: WARNING cinder.quota [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2095881982 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2095881982, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:07 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['62f0ca5a-53a6-47c6-ae2b-e11ce641b804', '1dec7600-b533-446d-8b78-e491e7eef303', '040c9950-f572-4f8b-bde6-fc85eac0cf45', '99a8a3bb-00e5-4f5f-bdf9-b85e3a3eb754'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:07 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-16b864c1-6585-4e5e-aa12-ee0f06f036d4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot f813da88-ee35-4f41-a03c-18ab8593a6e5: deleted successfully Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a1662-f7b7-4830-9789-7b79d85175c8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:08 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:28:08 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:08 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:08 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf Sep 28 18:28:08 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:09 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5415a243-a266-486c-8bdd-0f5e96d5edaf" returned: 0 in 0.287s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5415a243-a266-486c-8bdd-0f5e96d5edaf" released by "delete_volume" :: held 0.855s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['c875ac3c-d5df-490f-bc3b-0d45d8df356f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:09 devstack cinder-volume[86560]: WARNING cinder.db.api [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2095881982'] Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['13341dc3-9d33-4c1c-9d70-f58493b8d036', '9c174a76-aa24-446d-a198-5a706bf7f66a', '206d6b1e-6195-4f7b-9621-08cc0b387870', 'adf8d38d-1c3c-44c5-9899-57ddcd0d1a8e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:09 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:09 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:09 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.369s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:09 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-feed4c06-7d8c-4829-bef4-d031970f8bb5 tempest-GroupSnapshotsTest-2112396151 None] Delete group completed successfully. Sep 28 18:28:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9a4dc8d7-5ffe-4275-b4b7-c49b2eccaa4b tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-597039536: creating Sep 28 18:28:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9a4dc8d7-5ffe-4275-b4b7-c49b2eccaa4b tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-597039536: created successfully Sep 28 18:28:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9a4dc8d7-5ffe-4275-b4b7-c49b2eccaa4b tempest-GroupSnapshotsTest-2112396151 None] Create group completed successfully. Sep 28 18:28:16 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (14e905d4-0bf4-4071-9eaa-354c243ee6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd151bc7-868c-4db0-8907-ff847bf92b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd151bc7-868c-4db0-8907-ff847bf92b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166737369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,host='devstack@QuobyteHD#QuobyteHD',id=25690b4d-e278-4e2a-8a06-22218621e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:17Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6f540b-95c7-4f6d-bca7-d0a628189c62),volume_type_id=db6f540b-95c7-4f6d-bca7-d0a628189c62)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a377fba-2201-4a2a-98cc-1756488c2877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a377fba-2201-4a2a-98cc-1756488c2877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf2ae07-5fb6-49f4-be97-507a9102b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf2ae07-5fb6-49f4-be97-507a9102b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25690b4d-e278-4e2a-8a06-22218621e483', 'volume_name': 'volume-25690b4d-e278-4e2a-8a06-22218621e483', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccfacc-6112-4391-b26e-2c67008cf352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccfacc-6112-4391-b26e-2c67008cf352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41146375-ec58-4680-b9c3-cca12d2b68ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Volume 25690b4d-e278-4e2a-8a06-22218621e483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25690b4d-e278-4e2a-8a06-22218621e483', 'volume_size': 1} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,created_at=2026-09-28T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166737369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,host='devstack@QuobyteHD#QuobyteHD',id=25690b4d-e278-4e2a-8a06-22218621e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:17Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6f540b-95c7-4f6d-bca7-d0a628189c62),volume_type_id=db6f540b-95c7-4f6d-bca7-d0a628189c62)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Creating volume 25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:17 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:17 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 1073741824 Sep 28 18:28:17 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:17 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 1073741824" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:17 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 Sep 28 18:28:17 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:17 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483" returned: 0 in 0.242s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41146375-ec58-4680-b9c3-cca12d2b68ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25690b4d-e278-4e2a-8a06-22218621e483', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73bb6d7-052e-489e-83fd-04f65ed0eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Volume volume-25690b4d-e278-4e2a-8a06-22218621e483 (25690b4d-e278-4e2a-8a06-22218621e483): created successfully Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73bb6d7-052e-489e-83fd-04f65ed0eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (14e905d4-0bf4-4071-9eaa-354c243ee6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-07c48634-cbb7-4d42-a692-6bc9a936c02e tempest-GroupSnapshotsTest-2112396151 None] Created volume successfully. Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (063392f2-60a5-4c25-8720-e7df12520e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1906a6-e7dd-4e13-a4cf-c8b5ce20edfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1906a6-e7dd-4e13-a4cf-c8b5ce20edfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941370149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,host='devstack@QuobyteHD#QuobyteHD',id=2dfa0aa7-ffe6-4965-9b09-add21652ea07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:19Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6f540b-95c7-4f6d-bca7-d0a628189c62),volume_type_id=db6f540b-95c7-4f6d-bca7-d0a628189c62)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbafdba-ea0b-4d60-ad55-29574f71d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbafdba-ea0b-4d60-ad55-29574f71d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0e3591-fe2d-415d-8ea0-cf8a5c6ac694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0e3591-fe2d-415d-8ea0-cf8a5c6ac694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfa0aa7-ffe6-4965-9b09-add21652ea07', 'volume_name': 'volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f18b25-6fe6-4409-afa3-36368b9de2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f18b25-6fe6-4409-afa3-36368b9de2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b05afa-c7e2-4a36-8d8f-edea3632666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Volume 2dfa0aa7-ffe6-4965-9b09-add21652ea07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07', 'volume_size': 1} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,created_at=2026-09-28T16:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941370149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f5bb6a9-a96e-4bdb-956b-4a54f2689def,host='devstack@QuobyteHD#QuobyteHD',id=2dfa0aa7-ffe6-4965-9b09-add21652ea07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:19Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6f540b-95c7-4f6d-bca7-d0a628189c62),volume_type_id=db6f540b-95c7-4f6d-bca7-d0a628189c62)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Creating volume 2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:18 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:28:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 1073741824 Sep 28 18:28:18 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 1073741824" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:19 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 Sep 28 18:28:19 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07" returned: 0 in 0.240s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b05afa-c7e2-4a36-8d8f-edea3632666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcef9dd-0e62-4c38-a47a-b37cff0eaabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:19 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Volume volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 (2dfa0aa7-ffe6-4965-9b09-add21652ea07): created successfully Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcef9dd-0e62-4c38-a47a-b37cff0eaabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (063392f2-60a5-4c25-8720-e7df12520e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1b13d91b-8bfa-4252-98e6-d3253f3e1091 tempest-GroupSnapshotsTest-2112396151 None] Created volume successfully. Sep 28 18:28:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-75713bff-9b5d-4db0-8fb2-98069f70308a tempest-GroupSnapshotsTest-2112396151 None] Update group completed successfully. Sep 28 18:28:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c3963f0a-c06a-49f8-afc2-92aaaadce6fb tempest-GroupSnapshotsTest-2112396151 None] Update group completed successfully. Sep 28 18:28:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-34a46b67-a38f-4f1d-a50c-3da555126e20 tempest-GroupSnapshotsTest-2112396151 None] Update group completed successfully. Sep 28 18:28:23 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c69f0ec1-8053-43aa-9b1d-f6d9808e8ec1 tempest-GroupSnapshotsTest-2112396151 None] Update group completed successfully. Sep 28 18:28:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] GroupSnapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: creating. Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Group snapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: creating. {{(pid=86560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Creating offline snapshot bfaf3a70-0c07-4a0f-aaf1-09d437ad681f of volume 25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1379b-a996-4448-9251-72cfccea0d33]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:25 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 Sep 28 18:28:25 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:25 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:25 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f 1G Sep 28 18:28:25 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:25 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f 1G" returned: 0 in 0.401s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25690b4d-e278-4e2a-8a06-22218621e483 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:25 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25690b4d-e278-4e2a-8a06-22218621e483 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f Sep 28 18:28:25 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25690b4d-e278-4e2a-8a06-22218621e483 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" returned: 0 in 0.281s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f Sep 28 18:28:26 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" returned: 0 in 0.241s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info Sep 28 18:28:26 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info" returned: 0 in 0.270s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info Sep 28 18:28:26 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.info" returned: 0 in 0.280s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Creating offline snapshot c38311e0-ade9-409e-82ad-6be7f10a887e of volume 2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3829e0-422e-4049-b429-813c6aff14fe]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:27 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 Sep 28 18:28:27 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:27 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07" returned: 0 in 0.351s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:27 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e 1G Sep 28 18:28:27 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:27 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e 1G" returned: 0 in 0.404s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:27 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e Sep 28 18:28:27 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:27 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e" returned: 0 in 0.288s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:28 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e Sep 28 18:28:28 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:28 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e" returned: 0 in 0.312s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:28 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info Sep 28 18:28:28 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:28 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:28 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info Sep 28 18:28:28 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:28 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.info" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:28 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ffe13488-97ba-4019-9574-71619ca0380e tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: created successfully Sep 28 18:28:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: deleting Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: deleting {{(pid=86560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Deleting offline snapshot bfaf3a70-0c07-4a0f-aaf1-09d437ad681f of volume 25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] snapshot_file for this snap is: volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8024d-bdf3-44ff-a7ae-dc407725f891]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:29 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f Sep 28 18:28:29 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:29 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" returned: 0 in 0.433s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25690b4d-e278-4e2a-8a06-22218621e483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac48157-1dcf-4a1b-b201-c2d035cc1769]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:30 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 Sep 28 18:28:30 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:30 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:30 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f Sep 28 18:28:30 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:30 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:30 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f Sep 28 18:28:30 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:31 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483.bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-bfaf3a70-0c07-4a0f-aaf1-09d437ad681f" released by "_delete_snapshot" :: held 1.628s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" released by "delete_snapshot" :: held 1.654s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-c38311e0-ade9-409e-82ad-6be7f10a887e" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-c38311e0-ade9-409e-82ad-6be7f10a887e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Deleting offline snapshot c38311e0-ade9-409e-82ad-6be7f10a887e of volume 2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] snapshot_file for this snap is: volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb742f-04d9-44f4-9e1e-41c00d00abd1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:31 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e Sep 28 18:28:31 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:31 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3158676-5955-41fa-93bf-ac4832fe589d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:31 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 Sep 28 18:28:31 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:31 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:31 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e Sep 28 18:28:31 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:32 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e" returned: 0 in 0.340s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:32 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e Sep 28 18:28:32 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:32 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07.c38311e0-ade9-409e-82ad-6be7f10a887e" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-c38311e0-ade9-409e-82ad-6be7f10a887e" released by "_delete_snapshot" :: held 1.441s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" released by "delete_snapshot" :: held 1.464s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:32 devstack cinder-volume[86560]: WARNING cinder.quota [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1714838723 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1714838723, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:32 devstack cinder-volume[86560]: WARNING cinder.quota [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1714838723 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1714838723, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['0774e7f7-180d-488e-b4db-ff10561b7755', 'ba11dbbc-0a9c-4e78-953a-d30eb6ad5a22', 'cd1f80c0-ce52-4ff7-9683-a89d65edd24d', '386b8dc6-ed31-4db8-95f3-994b5ab31f2b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['0bc5a298-2967-4e9d-837f-5cf3f15cd8a3', '5ef1fcce-d495-4d9e-ac3a-210ef3b7fbd1', 'be542876-b43a-4872-8d3f-207ce58ab82f', 'd1183a59-e461-45fc-8b90-bce78b691e45'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9c11ff50-e5fd-4c3a-b9d5-bda2d6c40d62 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 4ca01c8b-3184-49a0-8c1c-de595394b25d: deleted successfully Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[120a4a1d-ef40-4e3e-b5aa-77586e89272d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:34 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 Sep 28 18:28:34 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:34 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:34 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483 Sep 28 18:28:34 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:34 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25690b4d-e278-4e2a-8a06-22218621e483" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-25690b4d-e278-4e2a-8a06-22218621e483" released by "delete_volume" :: held 0.709s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa57ad7-5f07-4e89-9c4b-3b2ae125f035]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:35 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 Sep 28 18:28:35 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07" returned: 0 in 0.364s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:35 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07 Sep 28 18:28:35 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2dfa0aa7-ffe6-4965-9b09-add21652ea07" returned: 0 in 0.305s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-2dfa0aa7-ffe6-4965-9b09-add21652ea07" released by "delete_volume" :: held 0.738s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['89eadd11-cf82-4b8e-b6f2-7280e936a43b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:35 devstack cinder-volume[86560]: WARNING cinder.quota [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1714838723 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1714838723, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['99a40333-8b4a-4744-804d-f7c3fd8052b6', 'cc80236f-428d-457b-8194-47e9b28be63f', 'ceb02c71-07b3-4812-944d-b0c4f3404a23', '3facfeca-ab13-4e92-8e36-6ee4dee4780a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:35 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['8101fefe-b0fd-410d-aabe-25ecc9588fa8', '765f1605-18a6-4b70-b21a-9e0962f6ec2d', '0295008a-2cd2-4fa1-b35c-3bf0d4f748d6', '5f7a6355-ff7f-4f8b-a5f6-06e59d79fb43'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:36 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:36 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:36 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.293s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b4c99468-f006-4145-8658-6a87de9dc58a tempest-GroupSnapshotsTest-2112396151 None] Delete group completed successfully. Sep 28 18:28:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1e147724-0436-4922-afe4-698f31f34b53 tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-1206344553: creating Sep 28 18:28:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1e147724-0436-4922-afe4-698f31f34b53 tempest-GroupSnapshotsTest-2112396151 None] Group tempest-GroupSnapshotsTest-Group-1206344553: created successfully Sep 28 18:28:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1e147724-0436-4922-afe4-698f31f34b53 tempest-GroupSnapshotsTest-2112396151 None] Create group completed successfully. Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=135,cinder:SELECT=122,cinder:INSERT=36,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (1632fb84-9405-44db-b118-9bd8ded5bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52234480-d0c1-4489-9c6b-1a12998dd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52234480-d0c1-4489-9c6b-1a12998dd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495063330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c27aa8-60d2-449d-a823-7c64ff70823d,host='devstack@QuobyteHD#QuobyteHD',id=5b33d514-9b8b-42be-8070-edc96fca0491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:39Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b3c685e-b0ff-47dc-98e0-90ccd0e38225),volume_type_id=2b3c685e-b0ff-47dc-98e0-90ccd0e38225)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808983b9-c197-4cc4-a28d-a48b1b2ef358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808983b9-c197-4cc4-a28d-a48b1b2ef358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58264ca4-40e0-40a4-9a49-ba4820179946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58264ca4-40e0-40a4-9a49-ba4820179946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b33d514-9b8b-42be-8070-edc96fca0491', 'volume_name': 'volume-5b33d514-9b8b-42be-8070-edc96fca0491', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88374dc0-b408-4ec3-9839-9e29183d9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88374dc0-b408-4ec3-9839-9e29183d9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d61527-339b-456d-a2eb-4cbcaaffdf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Volume 5b33d514-9b8b-42be-8070-edc96fca0491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b33d514-9b8b-42be-8070-edc96fca0491', 'volume_size': 1} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41c27aa8-60d2-449d-a823-7c64ff70823d,created_at=2026-09-28T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495063330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c27aa8-60d2-449d-a823-7c64ff70823d,host='devstack@QuobyteHD#QuobyteHD',id=5b33d514-9b8b-42be-8070-edc96fca0491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a7f3bb2cdf45a48dcae405103a95c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:39Z,use_quota=True,user_id='ebdb6a8bd8984c64b3832d26b53b4f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b3c685e-b0ff-47dc-98e0-90ccd0e38225),volume_type_id=2b3c685e-b0ff-47dc-98e0-90ccd0e38225)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Creating volume 5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:38 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:28:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:38 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 1073741824 Sep 28 18:28:38 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:39 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 1073741824" returned: 0 in 0.459s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=130,cinder:INSERT=30,cinder:UPDATE=119,cinder:DELETE=8 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:39 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 Sep 28 18:28:39 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:39 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d61527-339b-456d-a2eb-4cbcaaffdf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b33d514-9b8b-42be-8070-edc96fca0491', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2525f80-74cb-47e8-8c53-57b75c61210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:39 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Volume volume-5b33d514-9b8b-42be-8070-edc96fca0491 (5b33d514-9b8b-42be-8070-edc96fca0491): created successfully Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2525f80-74cb-47e8-8c53-57b75c61210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Flow 'volume_create_manager' (1632fb84-9405-44db-b118-9bd8ded5bad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-302a23ad-c79c-4310-b660-02b74de63751 tempest-GroupSnapshotsTest-2112396151 None] Created volume successfully. Sep 28 18:28:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] GroupSnapshot 8e999b37-07b5-4179-8f67-75372d70768d: creating. Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Group snapshot 8e999b37-07b5-4179-8f67-75372d70768d: creating. {{(pid=86560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Creating offline snapshot 276b8b1b-72ae-43b5-a468-2dd6912cc5a4 of volume 5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6de07f-dd83-4d88-afd0-f15705aaad23]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:40 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 Sep 28 18:28:40 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:40 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:40 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 1G Sep 28 18:28:40 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 1G" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b33d514-9b8b-42be-8070-edc96fca0491 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:41 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b33d514-9b8b-42be-8070-edc96fca0491 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 Sep 28 18:28:41 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b33d514-9b8b-42be-8070-edc96fca0491 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:41 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 Sep 28 18:28:41 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:41 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info Sep 28 18:28:41 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:28:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:42 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info Sep 28 18:28:42 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:42 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.info" returned: 0 in 0.250s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-decfd75d-b4fb-44ca-9775-4c425112d959 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 8e999b37-07b5-4179-8f67-75372d70768d: created successfully Sep 28 18:28:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 8e999b37-07b5-4179-8f67-75372d70768d: deleting Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 8e999b37-07b5-4179-8f67-75372d70768d: deleting {{(pid=86560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-276b8b1b-72ae-43b5-a468-2dd6912cc5a4" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-276b8b1b-72ae-43b5-a468-2dd6912cc5a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Deleting offline snapshot 276b8b1b-72ae-43b5-a468-2dd6912cc5a4 of volume 5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] snapshot_file for this snap is: volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b5d0a4-6a10-4cc5-a60a-dcd2c3d05584]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:42 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 Sep 28 18:28:42 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4" returned: 0 in 0.383s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b33d514-9b8b-42be-8070-edc96fca0491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef8762-2c7c-4c3f-acd8-47a9238e059e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 Sep 28 18:28:43 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491" returned: 0 in 0.358s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 Sep 28 18:28:43 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4" returned: 0 in 0.352s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4 Sep 28 18:28:43 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:44 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491.276b8b1b-72ae-43b5-a468-2dd6912cc5a4" returned: 0 in 0.240s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-276b8b1b-72ae-43b5-a468-2dd6912cc5a4" released by "_delete_snapshot" :: held 1.439s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" released by "delete_snapshot" :: held 1.468s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:44 devstack cinder-volume[86560]: WARNING cinder.quota [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1513272386 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1513272386, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:44 devstack cinder-volume[86560]: WARNING cinder.quota [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1513272386 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1513272386, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:44 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['e937841c-fea6-4241-8ddc-4758969dec7a', 'b44701aa-2351-4fae-a3b0-5c9c84a13f47', 'e8487851-7aac-4a24-a479-f1b3ffbe7f30', 'b2f3c366-67f0-4d14-a5b8-92fccf017821'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f7a0885d-98c3-4e9d-a6cb-ae94e4c206f4 tempest-GroupSnapshotsTest-2112396151 None] group_snapshot 8e999b37-07b5-4179-8f67-75372d70768d: deleted successfully Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f339b707-1ac9-4492-9a72-0aa9eb2dfdb9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:45 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 Sep 28 18:28:45 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:45 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491" returned: 0 in 0.558s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:45 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491 Sep 28 18:28:45 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:46 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-5b33d514-9b8b-42be-8070-edc96fca0491" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Lock "cinder-quobyte-5b33d514-9b8b-42be-8070-edc96fca0491" released by "delete_volume" :: held 0.938s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['b3f59c17-a65d-4a66-9b10-b4e7e90b700f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:46 devstack cinder-volume[86560]: WARNING cinder.quota [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1513272386 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1513272386, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Created reservations ['e87f2caf-f46b-459a-9bfb-971ba605f269', '5a307634-8e25-4812-84c2-a67376562ade', 'f96a976a-758a-4e7e-b4b3-55e231b4438b', 'e504009e-4e53-4fd7-a946-0312f0d56a2f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:46 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:46 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:46 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:46 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-820f4a82-52ba-4fb2-935b-e56b63b15159 tempest-GroupSnapshotsTest-2112396151 None] Delete group completed successfully. Sep 28 18:28:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-e5c903b7-71ae-4f08-92ac-50a7fa6d1785 tempest-TestShelveInstance-1203140826 None] Terminate volume connection completed successfully. Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-e5c903b7-71ae-4f08-92ac-50a7fa6d1785 tempest-TestShelveInstance-1203140826 None] Deleting attachment 199eba85-61a5-4d5e-81f7-023388c64edf. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Acquiring lock "cinder-bb404506-21c6-44cf-98db-d6bfcaa23e83-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "cinder-bb404506-21c6-44cf-98db-d6bfcaa23e83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Acquiring lock "cinder-quobyte-bb404506-21c6-44cf-98db-d6bfcaa23e83" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "cinder-quobyte-bb404506-21c6-44cf-98db-d6bfcaa23e83" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c4aa90-e96b-4efb-b1e5-f0017f978147]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 Sep 28 18:28:48 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:48 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83" returned: 0 in 0.428s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83 Sep 28 18:28:48 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:48 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-bb404506-21c6-44cf-98db-d6bfcaa23e83" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "cinder-quobyte-bb404506-21c6-44cf-98db-d6bfcaa23e83" released by "delete_volume" :: held 0.783s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG cinder.quota [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Created reservations ['5239109b-b8c0-4273-8531-009cddaedc68', 'ef2da103-c043-4cb4-99c8-83ea4124e2d4', '8c67892a-43c4-4b1c-a920-670718c734c7', '44860081-4514-4e9f-b768-f12434449f9e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:28:48 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:49 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:49 devstack cinder-volume[86560]: DEBUG cinder.manager [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Deleted volume successfully. Sep 28 18:28:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [req-a79de37b-2dca-49f2-9c4d-06ce6681dbc5 req-6576178e-4990-461f-895f-6651b80f2051 tempest-TestShelveInstance-1203140826 None] Lock "cinder-bb404506-21c6-44cf-98db-d6bfcaa23e83-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:58 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=33 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:59 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=25,cinder:DELETE=2,cinder:SELECT=27,cinder:INSERT=6 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:00 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:29:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Flow 'volume_create_manager' (29dd7e05-ff56-45e8-a561-14e1c4615b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4478bba8-e8c5-4552-a838-28eff536fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4478bba8-e8c5-4552-a838-28eff536fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81832db0-420f-41ae-aa02-baf9deb40368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d57cd16d81241338aa277eb3626bfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:03Z,use_quota=True,user_id='c9c713d1a2d34a7091a720c834d857cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba9bad8-ed0c-46c2-88ca-036ef660b7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba9bad8-ed0c-46c2-88ca-036ef660b7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed9936e-a4ff-4dc4-abf5-3aa108fe825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed9936e-a4ff-4dc4-abf5-3aa108fe825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81832db0-420f-41ae-aa02-baf9deb40368', 'volume_name': 'volume-81832db0-420f-41ae-aa02-baf9deb40368', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9dc0a6-d206-4160-9ac7-0fd24ba01805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9dc0a6-d206-4160-9ac7-0fd24ba01805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a9134-9b49-4444-9d95-1cf1f29791a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Volume 81832db0-420f-41ae-aa02-baf9deb40368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81832db0-420f-41ae-aa02-baf9deb40368', 'volume_size': 1} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81832db0-420f-41ae-aa02-baf9deb40368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d57cd16d81241338aa277eb3626bfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:03Z,use_quota=True,user_id='c9c713d1a2d34a7091a720c834d857cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Creating volume 81832db0-420f-41ae-aa02-baf9deb40368 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 1073741824 Sep 28 18:29:03 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 1073741824" returned: 0 in 0.426s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 Sep 28 18:29:03 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a9134-9b49-4444-9d95-1cf1f29791a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81832db0-420f-41ae-aa02-baf9deb40368', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb42643-93cb-4370-8ffd-b7428838581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Volume volume-81832db0-420f-41ae-aa02-baf9deb40368 (81832db0-420f-41ae-aa02-baf9deb40368): created successfully Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb42643-93cb-4370-8ffd-b7428838581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Flow 'volume_create_manager' (29dd7e05-ff56-45e8-a561-14e1c4615b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-97b499c4-50ed-484f-8cdf-3a32112f90ab tempest-CinderUnicodeTest-1345686944 None] Created volume successfully. Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Flow 'volume_create_manager' (11ffec72-3aad-46fc-9cfe-53a242a4be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39905d2-9665-4664-9830-bc0fb7ddb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39905d2-9665-4664-9830-bc0fb7ddb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-478958232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf99ae-0259-47a1-b400-5b64b6b8542f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d57cd16d81241338aa277eb3626bfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:05Z,use_quota=True,user_id='c9c713d1a2d34a7091a720c834d857cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9858e4-d205-4290-85a0-4a9859461e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9858e4-d205-4290-85a0-4a9859461e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e2fc87-b517-41b7-9f28-79ee112915f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e2fc87-b517-41b7-9f28-79ee112915f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bf99ae-0259-47a1-b400-5b64b6b8542f', 'volume_name': 'volume-08bf99ae-0259-47a1-b400-5b64b6b8542f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f2907e-00c1-43b6-bccb-110da1a52334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f2907e-00c1-43b6-bccb-110da1a52334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fd2177-10cb-472a-94e7-f075a55f5321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Volume 08bf99ae-0259-47a1-b400-5b64b6b8542f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bf99ae-0259-47a1-b400-5b64b6b8542f', 'volume_size': 1} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-478958232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf99ae-0259-47a1-b400-5b64b6b8542f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d57cd16d81241338aa277eb3626bfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:05Z,use_quota=True,user_id='c9c713d1a2d34a7091a720c834d857cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Creating volume 08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:05 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f 1073741824 Sep 28 18:29:05 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f 1073741824" returned: 0 in 0.503s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:06 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f Sep 28 18:29:06 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:06 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fd2177-10cb-472a-94e7-f075a55f5321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bf99ae-0259-47a1-b400-5b64b6b8542f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eff4f5-2d50-43a8-aed5-bb8ccc3a5be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Volume volume-08bf99ae-0259-47a1-b400-5b64b6b8542f (08bf99ae-0259-47a1-b400-5b64b6b8542f): created successfully Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eff4f5-2d50-43a8-aed5-bb8ccc3a5be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Flow 'volume_create_manager' (11ffec72-3aad-46fc-9cfe-53a242a4be69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-178ec34f-f5ad-4a15-8d91-dccd84f5d462 tempest-CinderUnicodeTest-1345686944 None] Created volume successfully. Sep 28 18:29:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Creating offline snapshot 7087b693-a2d6-4e89-b95e-d12d3361ea8e of volume 08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737198e-460f-4ddb-9782-7f0617a60acf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:07 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f Sep 28 18:29:07 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:08 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f" returned: 0 in 0.393s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:08 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e 1G Sep 28 18:29:08 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:08 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e 1G" returned: 0 in 0.438s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bf99ae-0259-47a1-b400-5b64b6b8542f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:08 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bf99ae-0259-47a1-b400-5b64b6b8542f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e Sep 28 18:29:08 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:08 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bf99ae-0259-47a1-b400-5b64b6b8542f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e" returned: 0 in 0.322s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:08 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e is being set with open permissions: ugo+rw Sep 28 18:29:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:08 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e Sep 28 18:29:08 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info Sep 28 18:29:09 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info is being set with open permissions: ugo+rw Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info Sep 28 18:29:09 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.info" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1e5e29e8-51dc-4afb-a3b5-159c21c21108 tempest-CinderUnicodeTest-1345686944 None] Create snapshot completed successfully Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-7087b693-a2d6-4e89-b95e-d12d3361ea8e-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-7087b693-a2d6-4e89-b95e-d12d3361ea8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-quobyte-7087b693-a2d6-4e89-b95e-d12d3361ea8e" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-7087b693-a2d6-4e89-b95e-d12d3361ea8e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Deleting offline snapshot 7087b693-a2d6-4e89-b95e-d12d3361ea8e of volume 08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] snapshot_file for this snap is: volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d2db6-287c-4f09-8af2-5448cf33ced5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e Sep 28 18:29:10 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:10 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e" returned: 0 in 0.374s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bf99ae-0259-47a1-b400-5b64b6b8542f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[accf35b1-face-45c0-984f-90487baa80f8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f Sep 28 18:29:10 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:10 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f" returned: 0 in 0.403s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e Sep 28 18:29:10 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e" returned: 0 in 0.346s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:11 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e Sep 28 18:29:11 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f.7087b693-a2d6-4e89-b95e-d12d3361ea8e" returned: 0 in 0.264s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-7087b693-a2d6-4e89-b95e-d12d3361ea8e" released by "_delete_snapshot" :: held 1.510s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" released by "delete_snapshot" :: held 1.535s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Created reservations ['65e6894e-701e-409a-ad25-082e5cc66154', 'd8762565-00dc-4e56-9feb-dcb47bd0a759', '89c92427-63c9-4c52-8098-3a68ba980f97', '9c333bbd-49b1-4ee6-b025-8a41f09c858f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Delete snapshot completed successfully. Sep 28 18:29:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-014ca649-b5c3-4bf5-83ce-8fc416e5658f tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-7087b693-a2d6-4e89-b95e-d12d3361ea8e-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-08bf99ae-0259-47a1-b400-5b64b6b8542f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-08bf99ae-0259-47a1-b400-5b64b6b8542f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcedaff-983b-44bb-af37-941538450bc2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:12 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f Sep 28 18:29:12 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:12 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:12 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f Sep 28 18:29:12 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:12 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-08bf99ae-0259-47a1-b400-5b64b6b8542f" returned: 0 in 0.266s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-08bf99ae-0259-47a1-b400-5b64b6b8542f" released by "delete_volume" :: held 0.743s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Created reservations ['0b3561bc-17f7-4f30-9554-d497a2f43b03', '494af5a7-83be-4d33-90e2-e0d4e5b7acbe', '6d0cb8a2-77ee-49ae-a9f3-8d29f50712e4', '5c5216e1-ab58-4965-97ab-0e6bce1b56e7'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:13 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:13 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-81832db0-420f-41ae-aa02-baf9deb40368-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:13 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.264s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-81832db0-420f-41ae-aa02-baf9deb40368-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Deleted volume successfully. Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-74e397dc-5e0b-4c86-a7b1-c5062d85bb30 tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-08bf99ae-0259-47a1-b400-5b64b6b8542f-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "cinder-quobyte-81832db0-420f-41ae-aa02-baf9deb40368" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-81832db0-420f-41ae-aa02-baf9deb40368" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e64e5-f5b4-4648-8306-50ba7f4e177d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:13 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 Sep 28 18:29:13 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:13 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:13 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368 Sep 28 18:29:13 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:14 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-81832db0-420f-41ae-aa02-baf9deb40368" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-quobyte-81832db0-420f-41ae-aa02-baf9deb40368" released by "delete_volume" :: held 0.707s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Created reservations ['2b6f9b2b-4971-469e-9833-1c7ce8b7e0c7', 'f8b5f5ff-514f-4d60-946e-9f5385572453', '39d4a366-837a-45ec-b74a-3362effa3b71', 'd7f1b8b1-90c4-4db0-9d92-e4e38c720cc2'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:14 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:14 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:14 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.277s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:14 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Deleted volume successfully. Sep 28 18:29:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ec5f954e-ed46-4032-ac5c-e7f8ef1de21b tempest-CinderUnicodeTest-1345686944 None] Lock "cinder-81832db0-420f-41ae-aa02-baf9deb40368-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (ff371818-0256-498e-a368-37ffdd7dabce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0224ac54-9318-4075-8895-40aae9ea48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0224ac54-9318-4075-8895-40aae9ea48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-628965485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:18Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61a588-ed6c-44e2-afa8-6d10cca8171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61a588-ed6c-44e2-afa8-6d10cca8171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b68625-54a9-44b0-96cf-d623eed5379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b68625-54a9-44b0-96cf-d623eed5379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4', 'volume_name': 'volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c4fed0-679f-4c48-9b1d-683d7352e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c4fed0-679f-4c48-9b1d-683d7352e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34efe949-1d8c-4759-a915-098fae99e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Volume a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4', 'volume_size': 1} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-628965485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:18Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Creating volume a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:18 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:18 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 1073741824 Sep 28 18:29:18 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:19 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 1073741824" returned: 0 in 0.486s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:19 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 Sep 28 18:29:19 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:19 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" returned: 0 in 0.343s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34efe949-1d8c-4759-a915-098fae99e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3bfa7-755c-4a12-a27d-2fcb9a90e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Volume volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 (a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4): created successfully Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3bfa7-755c-4a12-a27d-2fcb9a90e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (ff371818-0256-498e-a368-37ffdd7dabce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4379b494-04f9-4d2b-aece-7f165834620e tempest-VolumesListAdminTestJSON-2064187784 None] Created volume successfully. Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (541118fe-1fcd-42ef-9cf4-8cbe7c38cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6319564-8749-4708-9f04-6d17b68cacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6319564-8749-4708-9f04-6d17b68cacc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1785320710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416a678e-651c-4433-bfa2-23ad37237e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:21Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7905176-b1fd-4a15-96da-42e2e93afa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7905176-b1fd-4a15-96da-42e2e93afa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04078b2e-e0b4-414a-9092-32eb5e156d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04078b2e-e0b4-414a-9092-32eb5e156d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416a678e-651c-4433-bfa2-23ad37237e10', 'volume_name': 'volume-416a678e-651c-4433-bfa2-23ad37237e10', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab31952-3435-484f-94ff-35ac8afe2635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab31952-3435-484f-94ff-35ac8afe2635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f76011-9350-4156-8be0-7432c60fe0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Volume 416a678e-651c-4433-bfa2-23ad37237e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416a678e-651c-4433-bfa2-23ad37237e10', 'volume_size': 1} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1785320710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416a678e-651c-4433-bfa2-23ad37237e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:21Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Creating volume 416a678e-651c-4433-bfa2-23ad37237e10 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:21 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 1073741824 Sep 28 18:29:21 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:21 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 1073741824" returned: 0 in 0.528s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:21 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 Sep 28 18:29:21 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:22 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f76011-9350-4156-8be0-7432c60fe0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416a678e-651c-4433-bfa2-23ad37237e10', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d37139-707b-4d13-a4c7-d29ef5e8a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Volume volume-416a678e-651c-4433-bfa2-23ad37237e10 (416a678e-651c-4433-bfa2-23ad37237e10): created successfully Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d37139-707b-4d13-a4c7-d29ef5e8a693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (541118fe-1fcd-42ef-9cf4-8cbe7c38cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a117cefe-d235-4822-9ed5-ad080fe02f3b tempest-VolumesListAdminTestJSON-2064187784 None] Created volume successfully. Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (23829d51-a6aa-47e2-ac3e-8b34abf85103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84fc3b-577c-4720-b4c2-6ddb46d61a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84fc3b-577c-4720-b4c2-6ddb46d61a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448482698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c6daf7-45ec-46e4-afff-69e363551680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:24Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4ecb98-1efa-40fb-ae0c-f401aecfc83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4ecb98-1efa-40fb-ae0c-f401aecfc83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d451b938-b846-4975-9c55-b6b8224d6eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d451b938-b846-4975-9c55-b6b8224d6eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c6daf7-45ec-46e4-afff-69e363551680', 'volume_name': 'volume-d9c6daf7-45ec-46e4-afff-69e363551680', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba986b8-62f2-44ea-9473-b5119a02a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba986b8-62f2-44ea-9473-b5119a02a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457769d0-ed82-4245-a968-d24001267cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:23 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Volume d9c6daf7-45ec-46e4-afff-69e363551680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c6daf7-45ec-46e4-afff-69e363551680', 'volume_size': 1} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448482698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c6daf7-45ec-46e4-afff-69e363551680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f85b6cfa6b543d29c26b970a7fe0feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:24Z,use_quota=True,user_id='11b4ecb50b58471f90c794812125224d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Creating volume d9c6daf7-45ec-46e4-afff-69e363551680 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:23 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:23 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 1073741824 Sep 28 18:29:23 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:24 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 1073741824" returned: 0 in 0.462s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:24 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 Sep 28 18:29:24 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:24 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457769d0-ed82-4245-a968-d24001267cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c6daf7-45ec-46e4-afff-69e363551680', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e125e9-28c9-441e-854c-c80659a87a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:24 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Volume volume-d9c6daf7-45ec-46e4-afff-69e363551680 (d9c6daf7-45ec-46e4-afff-69e363551680): created successfully Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e125e9-28c9-441e-854c-c80659a87a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Flow 'volume_create_manager' (23829d51-a6aa-47e2-ac3e-8b34abf85103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9e7fb225-cfe8-4196-82a2-588ba3b1bebe tempest-VolumesListAdminTestJSON-2064187784 None] Created volume successfully. Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Flow 'volume_create_manager' (7f9a63c2-f7ab-426e-b700-2396de7340c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8e4016-985c-4c9a-95b3-ca72df232dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8e4016-985c-4c9a-95b3-ca72df232dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c349b099-602c-4816-b69c-8fdd9f1a3cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284819a9a8eb46bbaf3d1bfc294461c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='b37a32f70a4d4e44ba7e14accea37294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d32016e-b21e-423e-a1a0-624392dbf31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d32016e-b21e-423e-a1a0-624392dbf31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db16955-54ff-4451-9d87-00122d9dfaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db16955-54ff-4451-9d87-00122d9dfaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c349b099-602c-4816-b69c-8fdd9f1a3cbe', 'volume_name': 'volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44810592-e8dd-4070-b993-e5bed794f591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44810592-e8dd-4070-b993-e5bed794f591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e0d8-28f7-4a04-b5c9-8fe12c7fe685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Volume c349b099-602c-4816-b69c-8fdd9f1a3cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe', 'volume_size': 1} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c349b099-602c-4816-b69c-8fdd9f1a3cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284819a9a8eb46bbaf3d1bfc294461c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='b37a32f70a4d4e44ba7e14accea37294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Creating volume c349b099-602c-4816-b69c-8fdd9f1a3cbe {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:26 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:26 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe 1073741824 Sep 28 18:29:26 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:27 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe 1073741824" returned: 0 in 0.571s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:27 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe Sep 28 18:29:27 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:27 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e0d8-28f7-4a04-b5c9-8fe12c7fe685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7541e40d-22e3-4fff-82ca-3cece2c3deed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Volume volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe (c349b099-602c-4816-b69c-8fdd9f1a3cbe): created successfully Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7541e40d-22e3-4fff-82ca-3cece2c3deed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Flow 'volume_create_manager' (7f9a63c2-f7ab-426e-b700-2396de7340c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b627a507-511e-4e3e-8a27-a0e3f92c3ceb tempest-VolumesListAdminTestJSON-1722727723 None] Created volume successfully. Sep 28 18:29:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Acquiring lock "cinder-c349b099-602c-4816-b69c-8fdd9f1a3cbe-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "cinder-c349b099-602c-4816-b69c-8fdd9f1a3cbe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Acquiring lock "cinder-quobyte-c349b099-602c-4816-b69c-8fdd9f1a3cbe" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "cinder-quobyte-c349b099-602c-4816-b69c-8fdd9f1a3cbe" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f90b36-842d-4bc1-a45b-f19742266c5c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-d9c6daf7-45ec-46e4-afff-69e363551680-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-d9c6daf7-45ec-46e4-afff-69e363551680-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-quobyte-d9c6daf7-45ec-46e4-afff-69e363551680" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-d9c6daf7-45ec-46e4-afff-69e363551680" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9e79ef-bd48-48e2-8144-6b18a1d72fb3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe Sep 28 18:29:29 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 Sep 28 18:29:29 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe" returned: 0 in 0.525s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe Sep 28 18:29:29 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680 Sep 28 18:29:29 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c349b099-602c-4816-b69c-8fdd9f1a3cbe" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:29 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d9c6daf7-45ec-46e4-afff-69e363551680" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "cinder-quobyte-c349b099-602c-4816-b69c-8fdd9f1a3cbe" released by "delete_volume" :: held 0.941s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-d9c6daf7-45ec-46e4-afff-69e363551680" released by "delete_volume" :: held 0.788s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Created reservations ['6b42a5f2-10d6-4e7b-a245-a65d6d469455', '8fe457bf-1c10-4a17-995b-99217193b76d', 'aa4cc2db-6095-480c-8b0f-137b2072effe', '400d28cf-3f7c-4f1e-8678-3d18730c3cb3'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Created reservations ['6cda31a7-8003-4cd3-b14f-55f4e24259da', '4301d55f-b839-4494-bec6-b988cdebb9cc', '53619269-9d8d-4af7-9919-c5ab0eac7a40', 'd252f4ad-b674-4348-a7db-6950d58bbb9e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:30 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:30 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:30 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-416a678e-651c-4433-bfa2-23ad37237e10-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-416a678e-651c-4433-bfa2-23ad37237e10-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-quobyte-416a678e-651c-4433-bfa2-23ad37237e10" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-416a678e-651c-4433-bfa2-23ad37237e10" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6517c4-7b43-466b-9151-406f3ced88eb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.454s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Deleted volume successfully. Sep 28 18:29:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Deleted volume successfully. Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d2d689d6-00e9-4ef0-9f50-e35a658295fd tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-d9c6daf7-45ec-46e4-afff-69e363551680-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9fc82c2c-af32-443e-b55b-08eb330659ec tempest-VolumesListAdminTestJSON-1722727723 None] Lock "cinder-c349b099-602c-4816-b69c-8fdd9f1a3cbe-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 Sep 28 18:29:30 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10" returned: 0 in 0.479s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10 Sep 28 18:29:31 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-416a678e-651c-4433-bfa2-23ad37237e10" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-416a678e-651c-4433-bfa2-23ad37237e10" released by "delete_volume" :: held 0.815s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Created reservations ['1cbe1de7-6999-4c5f-b44e-398ddb2c4442', 'd5412ff0-4a48-4cb2-b8c1-2a1818edd4a2', 'ccdbd76c-297c-4b89-a6e7-fd4a3f1a140f', 'fedc30c8-48ca-4257-9791-ff37a7acf64e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:31 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "cinder-quobyte-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce9ecb-25ca-4234-98ac-b28387e3185a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.328s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Deleted volume successfully. Sep 28 18:29:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-873ead28-4f73-4f9f-9e47-ec2a7dc505e1 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-416a678e-651c-4433-bfa2-23ad37237e10-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:31 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 Sep 28 18:29:31 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:32 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" returned: 0 in 0.380s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:32 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4 Sep 28 18:29:32 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:32 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" returned: 0 in 0.243s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-quobyte-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4" released by "delete_volume" :: held 0.668s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Created reservations ['4229df15-eb21-4205-8eff-76cc17878f1e', '2ec1c186-b41b-40d4-a43c-9eaac62827e1', 'f47df120-2069-4352-b2a4-68435eeb0a71', 'f17c8cbe-7b15-4eb3-9fa5-172ddbc5de99'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:32 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:32 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:32 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Deleted volume successfully. Sep 28 18:29:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f04d065b-e19d-4cbf-8e5e-b1245dc41311 tempest-VolumesListAdminTestJSON-2064187784 None] Lock "cinder-a0c3061e-7df5-44f1-8f2d-94bd0cd7ddc4-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (e1422a63-f155-4529-8022-7272ced5a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f10f6de-664b-4b1b-9ecb-d9f7a97b7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f10f6de-664b-4b1b-9ecb-d9f7a97b7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-575127657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c7878c-e54f-45e7-be04-a4b8356bccc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac451747ae7e45efa07c7098af88bce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='5661249854014b5caa39f7bdeab34557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d06b04-4de7-4e4c-a7ad-1559197a1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d06b04-4de7-4e4c-a7ad-1559197a1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36593f2-20c8-4f3f-923e-af7789b249a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36593f2-20c8-4f3f-923e-af7789b249a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c7878c-e54f-45e7-be04-a4b8356bccc3', 'volume_name': 'volume-92c7878c-e54f-45e7-be04-a4b8356bccc3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90bd2cf-2aff-4549-951d-ee72a93f3d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90bd2cf-2aff-4549-951d-ee72a93f3d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd807b6-97f0-4745-8537-f1c47315baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Volume 92c7878c-e54f-45e7-be04-a4b8356bccc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c7878c-e54f-45e7-be04-a4b8356bccc3', 'volume_size': 1} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-575127657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c7878c-e54f-45e7-be04-a4b8356bccc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac451747ae7e45efa07c7098af88bce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:39Z,use_quota=True,user_id='5661249854014b5caa39f7bdeab34557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Creating volume 92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:38 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 1073741824 Sep 28 18:29:38 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 1073741824" returned: 0 in 0.437s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:39 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 Sep 28 18:29:39 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd807b6-97f0-4745-8537-f1c47315baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c7878c-e54f-45e7-be04-a4b8356bccc3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cb8f8-f16b-4f9e-9d8f-c93325c033af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:39 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Volume volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 (92c7878c-e54f-45e7-be04-a4b8356bccc3): created successfully Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cb8f8-f16b-4f9e-9d8f-c93325c033af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (e1422a63-f155-4529-8022-7272ced5a4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-18be2b03-7d4b-43d1-bfa3-a57ed4227536 tempest-VolumesDeleteCascade-2021521857 None] Created volume successfully. Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Creating offline snapshot d7efa483-7d8b-42d7-bb7a-e17ea4402f44 of volume 92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3283a48d-647a-428b-bd56-974e9f4da3b1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:41 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 Sep 28 18:29:41 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:41 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3" returned: 0 in 0.443s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:41 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 1G Sep 28 18:29:41 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:41 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 1G" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:42 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.360s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 is being set with open permissions: ugo+rw Sep 28 18:29:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:42 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.294s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info Sep 28 18:29:42 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info" returned: 0 in 0.288s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info is being set with open permissions: ugo+rw Sep 28 18:29:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:43 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info Sep 28 18:29:43 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:43 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.info" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0f991a5a-6f13-4dd0-a71a-0f34be78eb60 tempest-VolumesDeleteCascade-2021521857 None] Create snapshot completed successfully Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Creating offline snapshot b73130af-727b-4f73-8f97-3e4fa6948da0 of volume 92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc331d-5b08-4997-82ec-97892f64dc55]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:44 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:44 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Flow 'volume_create_manager' (e460297b-e480-4508-9468-4b8202563e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d4864a-9273-425f-aabc-d5207a7c0ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d4864a-9273-425f-aabc-d5207a7c0ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1672039081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11778a3-4084-49c3-ac36-934a36d31102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac198d9a094c868f6a5522fb861a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:45Z,use_quota=True,user_id='2ee0436bbc914245aedcb597190449a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77181ed1-ba08-4a29-a19d-ce4f63b954e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77181ed1-ba08-4a29-a19d-ce4f63b954e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f596a09-91e9-4d01-b2ef-e2ad4f044900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f596a09-91e9-4d01-b2ef-e2ad4f044900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11778a3-4084-49c3-ac36-934a36d31102', 'volume_name': 'volume-c11778a3-4084-49c3-ac36-934a36d31102', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5aed66-1606-4d7c-8ae7-9725e1bf043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5aed66-1606-4d7c-8ae7-9725e1bf043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd76adc-346d-4d9c-a9cc-671484788cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Volume c11778a3-4084-49c3-ac36-934a36d31102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11778a3-4084-49c3-ac36-934a36d31102', 'volume_size': 1} Sep 28 18:29:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:45 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.374s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c7878c-e54f-45e7-be04-a4b8356bccc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:45 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 1G Sep 28 18:29:45 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:45 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 1G" returned: 0 in 0.471s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:45 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 Sep 28 18:29:45 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:45 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:45 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 is being set with open permissions: ugo+rw Sep 28 18:29:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:45 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 Sep 28 18:29:45 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:46 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0" returned: 0 in 0.267s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.558s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1672039081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11778a3-4084-49c3-ac36-934a36d31102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac198d9a094c868f6a5522fb861a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:45Z,use_quota=True,user_id='2ee0436bbc914245aedcb597190449a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Creating volume c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:46 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 1073741824 Sep 28 18:29:46 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-828c70e3-8ba0-4836-a6e8-7627637a3f0e tempest-VolumesDeleteCascade-2021521857 None] Create snapshot completed successfully Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-92c7878c-e54f-45e7-be04-a4b8356bccc3-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-92c7878c-e54f-45e7-be04-a4b8356bccc3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:46 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Performing cascade delete. {{(pid=86560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 1073741824" returned: 0 in 0.554s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-b73130af-727b-4f73-8f97-3e4fa6948da0-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-b73130af-727b-4f73-8f97-3e4fa6948da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-b73130af-727b-4f73-8f97-3e4fa6948da0" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:46 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:29:46 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-b73130af-727b-4f73-8f97-3e4fa6948da0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Deleting offline snapshot b73130af-727b-4f73-8f97-3e4fa6948da0 of volume 92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] snapshot_file for this snap is: volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb457f-9ede-44c6-9782-18d5d9fa2dab]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:46 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 Sep 28 18:29:46 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.294s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd76adc-346d-4d9c-a9cc-671484788cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11778a3-4084-49c3-ac36-934a36d31102', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6077a4c4-b502-4ce3-b7cb-3d7cf12da31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Volume volume-c11778a3-4084-49c3-ac36-934a36d31102 (c11778a3-4084-49c3-ac36-934a36d31102): created successfully Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6077a4c4-b502-4ce3-b7cb-3d7cf12da31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Flow 'volume_create_manager' (e460297b-e480-4508-9468-4b8202563e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bc1121f6-3a12-4875-bcc3-cf17c791830c tempest-SnapshotDependencyTests-2056890969 None] Created volume successfully. Sep 28 18:29:47 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0" returned: 0 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c7878c-e54f-45e7-be04-a4b8356bccc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[90429ed9-010a-49f6-9c9b-2956f7ad075a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:47 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.418s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c7878c-e54f-45e7-be04-a4b8356bccc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 Sep 28 18:29:47 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0" returned: 0 in 0.395s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:48 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0 Sep 28 18:29:48 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Creating offline snapshot e1bd632f-6af3-4007-98a1-b4f32eea807a of volume c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[47788994-1f93-4333-b149-ab54535c244b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:48 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.b73130af-727b-4f73-8f97-3e4fa6948da0" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:48 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:29:48 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-b73130af-727b-4f73-8f97-3e4fa6948da0" released by "_delete_snapshot" :: held 1.613s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" released by "delete_snapshot" :: held 1.646s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['367dbce1-9170-409b-8b5a-34fcabdec4c0', '0a0c712d-ecb5-44f8-80b5-392b680dbf54', '5633cbc5-47a4-47b3-b7ed-58b68d88d4a9', '909ace23-c685-4ec4-8d8a-981b88c3b644'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Delete snapshot completed successfully. Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-b73130af-727b-4f73-8f97-3e4fa6948da0-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-d7efa483-7d8b-42d7-bb7a-e17ea4402f44-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-d7efa483-7d8b-42d7-bb7a-e17ea4402f44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-d7efa483-7d8b-42d7-bb7a-e17ea4402f44" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-d7efa483-7d8b-42d7-bb7a-e17ea4402f44" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Deleting offline snapshot d7efa483-7d8b-42d7-bb7a-e17ea4402f44 of volume 92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] snapshot_file for this snap is: volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[774aa373-298a-4c5d-9661-11c4a06d5835]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:48 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.426s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:48 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a 1G Sep 28 18:29:48 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:48 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c7878c-e54f-45e7-be04-a4b8356bccc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6483d9c-2182-42d7-b22c-593ccce66e2c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a 1G" returned: 0 in 0.462s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11778a3-4084-49c3-ac36-934a36d31102 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11778a3-4084-49c3-ac36-934a36d31102 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:29:49 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 Sep 28 18:29:49 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11778a3-4084-49c3-ac36-934a36d31102 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a is being set with open permissions: ugo+rw Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:29:49 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3" returned: 0 in 0.401s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:49 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info Sep 28 18:29:49 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.389s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44 Sep 28 18:29:49 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info" returned: 0 in 0.302s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info is being set with open permissions: ugo+rw Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info Sep 28 18:29:50 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3.d7efa483-7d8b-42d7-bb7a-e17ea4402f44" returned: 0 in 0.280s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-d7efa483-7d8b-42d7-bb7a-e17ea4402f44" released by "_delete_snapshot" :: held 1.612s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" released by "delete_snapshot" :: held 1.640s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['5252b99a-2979-4d3d-a755-bca91e2b32a3', '3fb3d0dc-7ca4-4132-a123-c60b3c980bfe', '241bd2a2-3c73-4cba-a374-4912d9f7f95d', 'ad925f05-9029-4643-86db-53186431d888'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:50 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.info" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ca296810-bf68-4b07-9483-ad62dbacc595 tempest-SnapshotDependencyTests-2056890969 None] Create snapshot completed successfully Sep 28 18:29:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Delete snapshot completed successfully. Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-d7efa483-7d8b-42d7-bb7a-e17ea4402f44-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Snapshots deleted, issuing volume delete {{(pid=86560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74849407-e94c-4fba-a458-c08595048a73]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 Sep 28 18:29:50 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3" returned: 0 in 0.353s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3 Sep 28 18:29:50 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:51 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-92c7878c-e54f-45e7-be04-a4b8356bccc3" returned: 0 in 0.236s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-92c7878c-e54f-45e7-be04-a4b8356bccc3" released by "delete_volume" :: held 0.655s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['2ac66e8c-8dc8-4b02-9e6f-1ffbc5f138f5', '33aa1ca9-a945-4463-be8b-41c7cf486ec4', '850960d7-79a2-48cd-93e6-838582015641', '4db1d54c-1cef-49dc-982c-21ca40a4c6a6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:51 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:29:51 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:51 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.243s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Deleted volume successfully. Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-00356dda-6228-4c4c-bf3c-77433b5227ba tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-92c7878c-e54f-45e7-be04-a4b8356bccc3-delete_volume" released by "delete_volume" :: held 4.900s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:51 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Flow 'volume_create_manager' (b2a29eea-913b-4212-a2de-3e311061f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e550cb0-3665-4d38-8d1e-4d9f8f60950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e550cb0-3665-4d38-8d1e-4d9f8f60950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283cd4bf-a1bc-4701-9103-334de8a44596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac198d9a094c868f6a5522fb861a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e1bd632f-6af3-4007-98a1-b4f32eea807a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:52Z,use_quota=True,user_id='2ee0436bbc914245aedcb597190449a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e610dd9-90dc-4f3a-903c-65e2c34021ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e610dd9-90dc-4f3a-903c-65e2c34021ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd78873-510f-454d-bb8f-440769713640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd78873-510f-454d-bb8f-440769713640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '283cd4bf-a1bc-4701-9103-334de8a44596', 'volume_name': 'volume-283cd4bf-a1bc-4701-9103-334de8a44596', 'volume_size': 1, 'snapshot_id': 'e1bd632f-6af3-4007-98a1-b4f32eea807a'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8dff12-5c44-42e0-91fe-4757579e90c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8dff12-5c44-42e0-91fe-4757579e90c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2ea11a-67a2-4b33-a6ce-7e729c03e7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Volume 283cd4bf-a1bc-4701-9103-334de8a44596: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-283cd4bf-a1bc-4701-9103-334de8a44596', 'volume_size': 1, 'snapshot_id': 'e1bd632f-6af3-4007-98a1-b4f32eea807a'} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a-283cd4bf-a1bc-4701-9103-334de8a44596" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a-283cd4bf-a1bc-4701-9103-334de8a44596" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Creating volume 283cd4bf-a1bc-4701-9103-334de8a44596 from snapshot e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] snapshot: e1bd632f-6af3-4007-98a1-b4f32eea807a, volume: 283cd4bf-a1bc-4701-9103-334de8a44596, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a386d-9df8-4207-b555-71d1c6738ae7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:29:52 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:52 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c11778a3-4084-49c3-ac36-934a36d31102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a27dd90-079a-4b91-9296-28121fb9bd70]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:29:52 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (c6f04e8f-f36e-4f30-a5a5-a129e654b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555b4b3e-a105-413f-8eb6-1a65d24557d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555b4b3e-a105-413f-8eb6-1a65d24557d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-851308358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a4cce-e74c-4072-a8f0-21616c30f08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac451747ae7e45efa07c7098af88bce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:53Z,use_quota=True,user_id='5661249854014b5caa39f7bdeab34557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639ed11-0fa6-40b7-bd8c-14060fabae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639ed11-0fa6-40b7-bd8c-14060fabae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5547eff1-7a59-48fc-b3a5-3ffc6b22a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5547eff1-7a59-48fc-b3a5-3ffc6b22a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770a4cce-e74c-4072-a8f0-21616c30f08e', 'volume_name': 'volume-770a4cce-e74c-4072-a8f0-21616c30f08e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16443a32-afb3-454f-b575-07b5291b75da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16443a32-afb3-454f-b575-07b5291b75da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb74da6-dfae-4b5e-b658-93e8118c0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Volume 770a4cce-e74c-4072-a8f0-21616c30f08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770a4cce-e74c-4072-a8f0-21616c30f08e', 'volume_size': 1} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:29:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:53 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 Sep 28 18:29:53 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:58 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596" returned: 0 in 5.937s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:58 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:29:58 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Converted 1024.00 MB image at 172.44 MB/s Sep 28 18:29:58 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 is being set with open permissions: ugo+rw Sep 28 18:29:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:58 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 Sep 28 18:29:58 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:59 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596" returned: 0 in 0.239s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" released by "_copy_volume_from_snapshot" :: held 7.052s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=105,cinder:SELECT=86,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a-283cd4bf-a1bc-4701-9103-334de8a44596" released by "_create_volume_from_snapshot" :: held 7.126s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.144s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.372s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-851308358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a4cce-e74c-4072-a8f0-21616c30f08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac451747ae7e45efa07c7098af88bce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:53Z,use_quota=True,user_id='5661249854014b5caa39f7bdeab34557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Creating volume 770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:59 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:59 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e 1073741824 Sep 28 18:29:59 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2ea11a-67a2-4b33-a6ce-7e729c03e7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283cd4bf-a1bc-4701-9103-334de8a44596', 'volume_size': 1, 'snapshot_id': 'e1bd632f-6af3-4007-98a1-b4f32eea807a'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c987be71-9556-4af4-a644-5ba5d76a9e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:59 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Volume volume-283cd4bf-a1bc-4701-9103-334de8a44596 (283cd4bf-a1bc-4701-9103-334de8a44596): created successfully Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c987be71-9556-4af4-a644-5ba5d76a9e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Flow 'volume_create_manager' (b2a29eea-913b-4212-a2de-3e311061f440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e14f2b0f-ddda-40f4-be22-7350f66ef169 tempest-SnapshotDependencyTests-2056890969 None] Created volume successfully. Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=84,cinder:UPDATE=105,cinder:DELETE=10,cinder:INSERT=28 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-e1bd632f-6af3-4007-98a1-b4f32eea807a-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-e1bd632f-6af3-4007-98a1-b4f32eea807a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Deleting offline snapshot e1bd632f-6af3-4007-98a1-b4f32eea807a of volume c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] snapshot_file for this snap is: volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0520011-d683-42ee-ac8d-8a872ec77faf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:59 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e 1073741824" returned: 0 in 0.482s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:59 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:29:59 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:59 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:29:59 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb74da6-dfae-4b5e-b658-93e8118c0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770a4cce-e74c-4072-a8f0-21616c30f08e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4501aa2-d0a7-41c6-ad09-6ee2a089afb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.360s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c11778a3-4084-49c3-ac36-934a36d31102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:00 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Volume volume-770a4cce-e74c-4072-a8f0-21616c30f08e (770a4cce-e74c-4072-a8f0-21616c30f08e): created successfully Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4501aa2-d0a7-41c6-ad09-6ee2a089afb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (c6f04e8f-f36e-4f30-a5a5-a129e654b252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[703b2b29-75d0-40ff-92f2-eca54e0d622b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-49b5e0da-b0c9-4def-95f0-fc0e944d99c5 tempest-VolumesDeleteCascade-2021521857 None] Created volume successfully. Sep 28 18:30:00 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:00 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:30:00 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Creating offline snapshot aceb6104-8438-4ea9-b6ea-53ece7a8a088 of volume 770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c8418a-356b-4a06-a3fb-b39bec28840f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:30:00 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.574s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:30:00 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.367s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 1G Sep 28 18:30:00 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:01 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a Sep 28 18:30:01 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:01 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102.e1bd632f-6af3-4007-98a1-b4f32eea807a" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:01 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 1G" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770a4cce-e74c-4072-a8f0-21616c30f08e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:01 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770a4cce-e74c-4072-a8f0-21616c30f08e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:01 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-e1bd632f-6af3-4007-98a1-b4f32eea807a" released by "_delete_snapshot" :: held 1.659s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" released by "delete_snapshot" :: held 1.692s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Created reservations ['25993a67-a562-4cca-b4ce-6700e5050351', '9d77f9fb-0475-4430-b9c4-c20083fd3124', 'edcba8a4-746a-4e78-87fb-b5524b13b993', '308018cc-fb63-4fad-a434-8adceee48b8d'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Delete snapshot completed successfully. Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-16a3bd4f-785f-4568-a8b7-95db08b024dc tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-e1bd632f-6af3-4007-98a1-b4f32eea807a-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:01 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770a4cce-e74c-4072-a8f0-21616c30f08e -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:01 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 is being set with open permissions: ugo+rw Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:01 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:01 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-c11778a3-4084-49c3-ac36-934a36d31102-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-c11778a3-4084-49c3-ac36-934a36d31102-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:01 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3333a7-8c58-42f0-ac22-416bd69bd200]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:01 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info Sep 28 18:30:02 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:30:02 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info" returned: 0 in 0.260s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info is being set with open permissions: ugo+rw Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:02 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info Sep 28 18:30:02 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:02 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102 Sep 28 18:30:02 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.info" returned: 0 in 0.246s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-54d7998d-2360-4e0e-9494-87eb249cc18a tempest-VolumesDeleteCascade-2021521857 None] Create snapshot completed successfully Sep 28 18:30:02 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-c11778a3-4084-49c3-ac36-934a36d31102" returned: 0 in 0.244s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-c11778a3-4084-49c3-ac36-934a36d31102" released by "delete_volume" :: held 0.696s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Created reservations ['33d71df9-baa8-4bb4-80fb-33b66e6f2ab2', 'c29ffa70-7c03-4927-8593-316c1cd709f1', '34e531c0-c63f-4dfc-8f23-dd188175ae1d', '4a735ee6-b438-447e-b0b7-df9441322daf'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:02 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:02 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-283cd4bf-a1bc-4701-9103-334de8a44596-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:02 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.283s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:02 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Deleted volume successfully. Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-283cd4bf-a1bc-4701-9103-334de8a44596-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-49584d6a-73e7-4efe-bb25-70a10575faf5 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-c11778a3-4084-49c3-ac36-934a36d31102-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66fc666-61cb-480b-a20b-c7e7adcb8412]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 Sep 28 18:30:03 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:03 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596 Sep 28 18:30:03 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:03 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-283cd4bf-a1bc-4701-9103-334de8a44596" returned: 0 in 0.282s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-quobyte-283cd4bf-a1bc-4701-9103-334de8a44596" released by "delete_volume" :: held 0.727s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Created reservations ['c0a3d4c9-6253-4e79-b959-45bce198b414', '542750f2-9ccb-4139-a069-d6ef15a87ccb', '206cb7b7-85a8-46b4-bafa-91a96fb500d6', 'a7f49cd8-8a88-4903-b17f-114951c6334e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:03 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:04 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (560a3e8a-fb34-4e83-9421-9588ed8f86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c49ff60-4098-4fe3-becc-de67e52b56aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.308s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Deleted volume successfully. Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c49ff60-4098-4fe3-becc-de67e52b56aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1705113707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac451747ae7e45efa07c7098af88bce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aceb6104-8438-4ea9-b6ea-53ece7a8a088,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:04Z,use_quota=True,user_id='5661249854014b5caa39f7bdeab34557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be08f4d1-0e15-4bfb-88a1-b0cab9100f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be08f4d1-0e15-4bfb-88a1-b0cab9100f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1558b66-0012-4f1b-834c-2f23cac6ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1558b66-0012-4f1b-834c-2f23cac6ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51', 'volume_name': 'volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51', 'volume_size': 1, 'snapshot_id': 'aceb6104-8438-4ea9-b6ea-53ece7a8a088'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4446684-e777-4185-95c8-7c8c8ee5acfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4446684-e777-4185-95c8-7c8c8ee5acfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d18a3bc-7383-45ab-bb62-130367e743c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Volume 2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51', 'volume_size': 1, 'snapshot_id': 'aceb6104-8438-4ea9-b6ea-53ece7a8a088'} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-263efb4e-26fa-4fdd-b9be-dced1cfca0c7 tempest-SnapshotDependencyTests-2056890969 None] Lock "cinder-283cd4bf-a1bc-4701-9103-334de8a44596-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Creating volume 2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 from snapshot aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] snapshot: aceb6104-8438-4ea9-b6ea-53ece7a8a088, volume: 2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfcebeb-63dc-4a69-bb09-6e15721e0234]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:04 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:04 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:04 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.390s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770a4cce-e74c-4072-a8f0-21616c30f08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f00376-adcb-4559-9ed1-768aa52e8903]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:04 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:30:04 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:05 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.433s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:30:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:30:05 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:30:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:05 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 Sep 28 18:30:05 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" returned: 0 in 6.911s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:30:12 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Converted 1024.00 MB image at 148.14 MB/s Sep 28 18:30:12 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 is being set with open permissions: ugo+rw Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 Sep 28 18:30:12 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" returned: 0 in 0.239s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" released by "_copy_volume_from_snapshot" :: held 8.068s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" released by "_create_volume_from_snapshot" :: held 8.138s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.161s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d18a3bc-7383-45ab-bb62-130367e743c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51', 'volume_size': 1, 'snapshot_id': 'aceb6104-8438-4ea9-b6ea-53ece7a8a088'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b01395-511a-4c38-bc8c-eb65019d70d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Volume volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 (2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51): created successfully Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b01395-511a-4c38-bc8c-eb65019d70d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Flow 'volume_create_manager' (560a3e8a-fb34-4e83-9421-9588ed8f86d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4c7a0a5a-c9b1-4fd4-b243-0b554072f99e tempest-VolumesDeleteCascade-2021521857 None] Created volume successfully. Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-770a4cce-e74c-4072-a8f0-21616c30f08e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-770a4cce-e74c-4072-a8f0-21616c30f08e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Performing cascade delete. {{(pid=86560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-aceb6104-8438-4ea9-b6ea-53ece7a8a088-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-aceb6104-8438-4ea9-b6ea-53ece7a8a088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Deleting offline snapshot aceb6104-8438-4ea9-b6ea-53ece7a8a088 of volume 770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] snapshot_file for this snap is: volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c794bd-f861-4ab7-87f1-4a5ffe638293]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:13 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.388s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770a4cce-e74c-4072-a8f0-21616c30f08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[761a26a7-f183-4a17-90de-3d58529c7546]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:30:13 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.571s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:14 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.331s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088 Sep 28 18:30:14 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e.aceb6104-8438-4ea9-b6ea-53ece7a8a088" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-aceb6104-8438-4ea9-b6ea-53ece7a8a088" released by "_delete_snapshot" :: held 1.677s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" released by "delete_snapshot" :: held 1.703s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['2ec10de0-a197-4939-a83d-b4de5aba8885', 'c11a1354-c481-4ecd-af8b-e74659a88a56', 'f9da1a53-7a56-4ba5-9e84-1a1f2f090d4d', '665df774-39e8-4fd6-b504-97e602a55fcb'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:14 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Delete snapshot completed successfully. Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-aceb6104-8438-4ea9-b6ea-53ece7a8a088-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Snapshots deleted, issuing volume delete {{(pid=86560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa09db1b-6cfa-4ed6-b96e-259519446907]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:30:15 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.426s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e Sep 28 18:30:15 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-770a4cce-e74c-4072-a8f0-21616c30f08e" returned: 0 in 0.281s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-770a4cce-e74c-4072-a8f0-21616c30f08e" released by "delete_volume" :: held 0.789s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['f1db86e1-7b95-4123-bf53-c8acad9aa996', '7f098a55-b8eb-4c62-bda8-323bd64aaa29', '820ef96e-b393-4004-b8f7-af9b77040551', 'cab40cc3-bc6e-42b5-a149-8a30c561be16'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:15 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Deleted volume successfully. Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e44fe739-8122-4246-af15-d5e110cc00e7 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-770a4cce-e74c-4072-a8f0-21616c30f08e-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b052471-f156-494e-8d2f-2f394e605821]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 Sep 28 18:30:16 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" returned: 0 in 0.448s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51 Sep 28 18:30:17 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-quobyte-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51" released by "delete_volume" :: held 0.795s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Created reservations ['8aeb33d2-07bb-43d2-8d1f-aaeefc9628cd', '66d0305d-172d-4f3b-9bed-e1ef41f03304', '8d98fae4-d736-4993-bea3-d681144785d9', '3406c4f3-22cd-43e8-a2d5-5612599eebb5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:17 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.355s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Deleted volume successfully. Sep 28 18:30:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-253dc1d6-eae7-4ed6-8c9d-ba6e4f426947 tempest-VolumesDeleteCascade-2021521857 None] Lock "cinder-2cf42e8a-d14a-44b1-9d1f-dd0565fc0b51-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Flow 'volume_create_manager' (66f55b16-813e-4029-afed-888011a2f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6ae04-42e2-4552-8224-f9f593d60334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6ae04-42e2-4552-8224-f9f593d60334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-430730317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2903ed5d-dcc0-4040-8008-0e018ec3ccf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c208fba00de4710bd2559a60b0eea41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:21Z,use_quota=True,user_id='ac6e59e8814f4d5bb846017c7f997329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773475de-221e-40fa-b5f4-1430e946597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773475de-221e-40fa-b5f4-1430e946597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1713817-a694-426d-93ac-44f6ee5e75bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1713817-a694-426d-93ac-44f6ee5e75bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2903ed5d-dcc0-4040-8008-0e018ec3ccf2', 'volume_name': 'volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e29eea-f631-4ca1-b49a-5f9040d7b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e29eea-f631-4ca1-b49a-5f9040d7b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a596fdd-732b-4a17-9b32-280a03accfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Volume 2903ed5d-dcc0-4040-8008-0e018ec3ccf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2', 'volume_size': 1} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-430730317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2903ed5d-dcc0-4040-8008-0e018ec3ccf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c208fba00de4710bd2559a60b0eea41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:21Z,use_quota=True,user_id='ac6e59e8814f4d5bb846017c7f997329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Creating volume 2903ed5d-dcc0-4040-8008-0e018ec3ccf2 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:30:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 1073741824 Sep 28 18:30:21 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 1073741824" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 Sep 28 18:30:22 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" returned: 0 in 0.283s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a596fdd-732b-4a17-9b32-280a03accfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759ba99-e72e-4c50-b63f-f6b3d71b8f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Volume volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 (2903ed5d-dcc0-4040-8008-0e018ec3ccf2): created successfully Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759ba99-e72e-4c50-b63f-f6b3d71b8f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Flow 'volume_create_manager' (66f55b16-813e-4029-afed-888011a2f83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-27d037bb-6f46-4fdc-b670-3b00f0c1d1df tempest-VolumesMetadataTest-2064515393 None] Created volume successfully. Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Acquiring lock "cinder-2903ed5d-dcc0-4040-8008-0e018ec3ccf2-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "cinder-2903ed5d-dcc0-4040-8008-0e018ec3ccf2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Acquiring lock "cinder-quobyte-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "cinder-quobyte-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd4d8e-c1e6-457c-acb5-e4e127b7302a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 Sep 28 18:30:23 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2 Sep 28 18:30:23 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "cinder-quobyte-2903ed5d-dcc0-4040-8008-0e018ec3ccf2" released by "delete_volume" :: held 0.656s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:23 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Created reservations ['c402008c-4120-4d74-ab42-9f8ea5ffac83', '9f070ffe-2cfd-4231-be3c-560399f577db', '86038ab6-00f2-4f53-b00b-c5adc803679c', 'ea42ba10-d8ed-4557-92db-d80f2d36e8c6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:24 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Deleted volume successfully. Sep 28 18:30:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-607991f9-5452-407a-8e3a-5d67133d277a tempest-VolumesMetadataTest-2064515393 None] Lock "cinder-2903ed5d-dcc0-4040-8008-0e018ec3ccf2-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Flow 'volume_create_manager' (1f3b9f33-3fd2-45d1-aad9-71b7f4415ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d07da89-9609-4a72-b87e-5d2edbd5f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d07da89-9609-4a72-b87e-5d2edbd5f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1249410947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d59d59a-8848-4dde-8705-54600841c277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42440c1f4c3466d83a37e32e7ce6110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:28Z,use_quota=True,user_id='e6549387e751467597efe601c64b4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b53e6f-2497-4009-b3a5-435d8343e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b53e6f-2497-4009-b3a5-435d8343e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc836d9c-8708-4e54-aadb-1e34d7b5791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc836d9c-8708-4e54-aadb-1e34d7b5791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d59d59a-8848-4dde-8705-54600841c277', 'volume_name': 'volume-8d59d59a-8848-4dde-8705-54600841c277', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57da52ea-106f-4fc2-a496-26cac1ae0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57da52ea-106f-4fc2-a496-26cac1ae0c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3786d-94ee-4d4e-977f-0b29a54ff0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Volume 8d59d59a-8848-4dde-8705-54600841c277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d59d59a-8848-4dde-8705-54600841c277', 'volume_size': 1} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1249410947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d59d59a-8848-4dde-8705-54600841c277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42440c1f4c3466d83a37e32e7ce6110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:28Z,use_quota=True,user_id='e6549387e751467597efe601c64b4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Creating volume 8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:28 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 1073741824 Sep 28 18:30:28 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 1073741824" returned: 0 in 0.478s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:28 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3786d-94ee-4d4e-977f-0b29a54ff0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d59d59a-8848-4dde-8705-54600841c277', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b55da64-bc8a-48aa-8c65-356700189828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Volume volume-8d59d59a-8848-4dde-8705-54600841c277 (8d59d59a-8848-4dde-8705-54600841c277): created successfully Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b55da64-bc8a-48aa-8c65-356700189828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Flow 'volume_create_manager' (1f3b9f33-3fd2-45d1-aad9-71b7f4415ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d4aee1cc-685b-44f9-a86c-f50adb512887 tempest-VolumesCloneTest-100220836 None] Created volume successfully. Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Flow 'volume_create_manager' (80de7b82-12f1-4712-8b7a-abb36eab88e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0090ea9-77fc-41b9-b594-ae8f87f4b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0090ea9-77fc-41b9-b594-ae8f87f4b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-922883085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab9f942-143e-45dc-b9c7-a1e8db8ce211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42440c1f4c3466d83a37e32e7ce6110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8d59d59a-8848-4dde-8705-54600841c277,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:30Z,use_quota=True,user_id='e6549387e751467597efe601c64b4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a325f4e-031e-4bb4-af3c-9f08f03d259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a325f4e-031e-4bb4-af3c-9f08f03d259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a9d01-b8b3-42ae-9fd9-dcbd2d19c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a9d01-b8b3-42ae-9fd9-dcbd2d19c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ab9f942-143e-45dc-b9c7-a1e8db8ce211', 'volume_name': 'volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211', 'volume_size': 2, 'source_volid': '8d59d59a-8848-4dde-8705-54600841c277', 'source_volstatus': 'available'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0289db-5814-437d-b23c-ac145c129d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0289db-5814-437d-b23c-ac145c129d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be98b4a-920b-4c88-8bfe-f4e8fa4441b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Volume 4ab9f942-143e-45dc-b9c7-a1e8db8ce211: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211', 'volume_size': 2, 'source_volid': '8d59d59a-8848-4dde-8705-54600841c277', 'source_volstatus': 'available'} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:30 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Cloning volume 8d59d59a-8848-4dde-8705-54600841c277 to volume 4ab9f942-143e-45dc-b9c7-a1e8db8ce211 Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Creating offline snapshot 4954ed70-aaf7-443d-b30f-f946f255b3f3 of volume 8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b015c44-d9fe-484a-a4ab-2244058532b2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:30 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.445s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 1G Sep 28 18:30:30 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 1G" returned: 0 in 0.439s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59d59a-8848-4dde-8705-54600841c277 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59d59a-8848-4dde-8705-54600841c277 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:31 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59d59a-8848-4dde-8705-54600841c277 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 is being set with open permissions: ugo+rw Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:31 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.283s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info Sep 28 18:30:31 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info is being set with open permissions: ugo+rw Sep 28 18:30:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info Sep 28 18:30:31 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:32 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.info" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] snapshot: 4954ed70-aaf7-443d-b30f-f946f255b3f3, volume: 4ab9f942-143e-45dc-b9c7-a1e8db8ce211, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2590a25-3a5c-4b86-a208-b44652ec2b26]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:32 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:32 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:32 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.377s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d59d59a-8848-4dde-8705-54600841c277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c66ceb2-b9ef-4701-815f-1d7e8e0ffedd]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:32 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:32 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:32 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.385s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:30:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:32 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 Sep 28 18:30:32 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" returned: 0 in 6.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:30:39 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Converted 1024.00 MB image at 160.54 MB/s Sep 28 18:30:39 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 is being set with open permissions: ugo+rw Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 Sep 28 18:30:39 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" released by "_copy_volume_from_snapshot" :: held 7.465s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-quobyte-4954ed70-aaf7-443d-b30f-f946f255b3f3" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4954ed70-aaf7-443d-b30f-f946f255b3f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Deleting offline snapshot 4954ed70-aaf7-443d-b30f-f946f255b3f3 of volume 8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] snapshot_file for this snap is: volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a7f41-6d3a-4200-9fbf-f9cfaba8e818]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:39 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.386s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d59d59a-8848-4dde-8705-54600841c277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c98b7-0f32-4693-891f-31df6811566d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:40 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:40 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.566s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:40 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:40 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3 Sep 28 18:30:41 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277.4954ed70-aaf7-443d-b30f-f946f255b3f3" returned: 0 in 0.250s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4954ed70-aaf7-443d-b30f-f946f255b3f3" released by "_delete_snapshot" :: held 1.647s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.273s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be98b4a-920b-4c88-8bfe-f4e8fa4441b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211', 'volume_size': 2, 'source_volid': '8d59d59a-8848-4dde-8705-54600841c277', 'source_volstatus': 'available'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55bc597-7f55-45d7-83c0-bf2041eefbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Volume volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 (4ab9f942-143e-45dc-b9c7-a1e8db8ce211): created successfully Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55bc597-7f55-45d7-83c0-bf2041eefbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Flow 'volume_create_manager' (80de7b82-12f1-4712-8b7a-abb36eab88e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8ec72e8b-d533-4d2d-881f-c0468361a933 tempest-VolumesCloneTest-100220836 None] Created volume successfully. Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-4ab9f942-143e-45dc-b9c7-a1e8db8ce211-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "cinder-4ab9f942-143e-45dc-b9c7-a1e8db8ce211-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea5064-f2ac-4808-bf49-b246fe0f8619]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:42 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 Sep 28 18:30:42 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:42 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" returned: 0 in 0.389s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:42 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211 Sep 28 18:30:42 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:42 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-4ab9f942-143e-45dc-b9c7-a1e8db8ce211" released by "delete_volume" :: held 0.678s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Created reservations ['134a8424-fa16-4920-bff4-eb3f7fa87818', 'b1a9fdbd-c39b-4f53-9e6f-8c7c499ed4a6', 'ff309d5e-11ef-44b8-a23e-d9eb23f81265', '3cc51ba7-19aa-42ca-871a-fde51f9aea75'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:42 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:42 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:43 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Deleted volume successfully. Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1f865a84-86a7-41a3-a2cf-36e7437ec7c1 tempest-VolumesCloneTest-100220836 None] Lock "cinder-4ab9f942-143e-45dc-b9c7-a1e8db8ce211-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-8d59d59a-8848-4dde-8705-54600841c277-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "cinder-8d59d59a-8848-4dde-8705-54600841c277-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Acquiring lock "cinder-quobyte-8d59d59a-8848-4dde-8705-54600841c277" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-8d59d59a-8848-4dde-8705-54600841c277" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde5a28-e893-40f1-8035-0a8ecc446cf7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:43 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:43 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:43 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:43 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277 Sep 28 18:30:43 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8d59d59a-8848-4dde-8705-54600841c277" returned: 0 in 0.249s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "cinder-quobyte-8d59d59a-8848-4dde-8705-54600841c277" released by "delete_volume" :: held 0.755s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Created reservations ['811f2bb0-4345-4ba8-8bc1-d1b660362f68', 'a1c2e6fd-c29f-4886-a509-5494d6e36eb1', 'b2ad1fa1-13e9-4b6a-b4c2-1373978b1173', '6cb158b9-7029-45fb-96a6-65a41087e2e6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:30:44 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Deleted volume successfully. Sep 28 18:30:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4cf76b39-c771-4eab-b2cb-3ff459ecf843 tempest-VolumesCloneTest-100220836 None] Lock "cinder-8d59d59a-8848-4dde-8705-54600841c277-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:54 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=63,cinder:UPDATE=75,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:54 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=8,cinder:SELECT=63 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Flow 'volume_create_manager' (70ab3b12-8b8d-475e-96e1-a7aac647c020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c11154-bdb3-4e62-89c6-f1e27814a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c11154-bdb3-4e62-89c6-f1e27814a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-405425941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bdf425-a29b-4cd6-83a7-b53c44d03ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98621ee12b184ce5a117a6caf42cb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:56Z,use_quota=True,user_id='0245a6d53a784edcb3584b39f9cbbf95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9650b04-9627-46c8-b1d8-f8c8f2ae412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9650b04-9627-46c8-b1d8-f8c8f2ae412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fda1e-1f0b-4251-9a95-b441436b6bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fda1e-1f0b-4251-9a95-b441436b6bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bdf425-a29b-4cd6-83a7-b53c44d03ebd', 'volume_name': 'volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc2e650-9f3a-4da2-8d92-9bde5694a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc2e650-9f3a-4da2-8d92-9bde5694a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c42eac9-38b5-40fd-a885-7b33089b807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd', 'volume_size': 1} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-405425941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bdf425-a29b-4cd6-83a7-b53c44d03ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98621ee12b184ce5a117a6caf42cb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:56Z,use_quota=True,user_id='0245a6d53a784edcb3584b39f9cbbf95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Creating volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:56 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd 1073741824 Sep 28 18:30:56 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:56 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd 1073741824" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd Sep 28 18:30:56 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" returned: 0 in 0.249s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c42eac9-38b5-40fd-a885-7b33089b807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d707f8b-5f28-4b23-a4f6-205e822e258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:57 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Volume volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd (a7bdf425-a29b-4cd6-83a7-b53c44d03ebd): created successfully Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d707f8b-5f28-4b23-a4f6-205e822e258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Flow 'volume_create_manager' (70ab3b12-8b8d-475e-96e1-a7aac647c020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:57 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-35567008-c660-4e69-8e3a-d37903139f69 tempest-VolumesSnapshotListTestJSON-440707068 None] Created volume successfully. Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Creating offline snapshot 24e35e9a-ffbe-4074-acfa-b10c7e48fe61 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00362f-7c9d-41ce-a785-5082ce86382e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:57 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd Sep 28 18:30:57 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 1G Sep 28 18:30:58 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 1G" returned: 0 in 0.387s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:30:58 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.300s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 is being set with open permissions: ugo+rw Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:30:58 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.237s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info Sep 28 18:30:58 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info" returned: 0 in 0.245s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:59 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info is being set with open permissions: ugo+rw Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:59 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info Sep 28 18:30:59 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.info" returned: 0 in 0.241s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-342c87c0-79b8-4026-9ba2-75ff55a58a65 tempest-VolumesSnapshotListTestJSON-440707068 None] Create snapshot completed successfully Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Creating offline snapshot 0b203c3b-f713-4df2-a7ba-0bcbdb028258 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c02f94-f762-47b5-994c-9b23e96ed65f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:31:00 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:31:00 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.364s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 1G Sep 28 18:31:00 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:31:00 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 1G" returned: 0 in 0.437s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:00 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:01 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:01 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 is being set with open permissions: ugo+rw Sep 28 18:31:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:01 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:01 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:01 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.472s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-af6b152a-a1ec-4432-8b7d-592b9a08f53f tempest-VolumesSnapshotListTestJSON-440707068 None] Create snapshot completed successfully Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Creating offline snapshot 491237c2-a858-486b-b635-c005a8b88ce1 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[537324dc-cd70-426e-a9c6-63ce492f5493]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:02 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.396s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 1G Sep 28 18:31:02 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 1G" returned: 0 in 0.505s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 Sep 28 18:31:03 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 is being set with open permissions: ugo+rw Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 Sep 28 18:31:03 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.571s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-982257f9-00ce-4593-a415-7150943dfc7c tempest-VolumesSnapshotListTestJSON-440707068 None] Create snapshot completed successfully Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-491237c2-a858-486b-b635-c005a8b88ce1-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-491237c2-a858-486b-b635-c005a8b88ce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-491237c2-a858-486b-b635-c005a8b88ce1" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-491237c2-a858-486b-b635-c005a8b88ce1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Deleting offline snapshot 491237c2-a858-486b-b635-c005a8b88ce1 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] snapshot_file for this snap is: volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db68c0-e3c4-4193-b871-70a481e01cb2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 Sep 28 18:31:05 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:05 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e23d7e-9d1d-4cdf-85c8-3b70836bd5c0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:05 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:05 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.379s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 Sep 28 18:31:05 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1" returned: 0 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1 Sep 28 18:31:06 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.491237c2-a858-486b-b635-c005a8b88ce1" returned: 0 in 0.244s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-491237c2-a858-486b-b635-c005a8b88ce1" released by "_delete_snapshot" :: held 1.522s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" released by "delete_snapshot" :: held 1.545s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Created reservations ['9d558017-a2ef-49c9-8777-9edd8201595d', 'd9a5ac26-0dcc-4db7-8987-e11dbbc8acc2', '1588b0d8-64f6-4868-a394-03839d91015b', 'e2a88933-6646-4fd6-af19-52629458506b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Delete snapshot completed successfully. Sep 28 18:31:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d66aea51-ac44-4888-a3a8-1165bd0576a6 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-491237c2-a858-486b-b635-c005a8b88ce1-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-0b203c3b-f713-4df2-a7ba-0bcbdb028258-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-0b203c3b-f713-4df2-a7ba-0bcbdb028258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-0b203c3b-f713-4df2-a7ba-0bcbdb028258" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-0b203c3b-f713-4df2-a7ba-0bcbdb028258" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Deleting offline snapshot 0b203c3b-f713-4df2-a7ba-0bcbdb028258 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] snapshot_file for this snap is: volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0fecc-d509-4010-b40b-c6df2816273e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:07 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.355s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003a913-9e6c-44cb-bbea-5441d7ee1a29]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:31:07 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:08 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.370s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258 Sep 28 18:31:08 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.0b203c3b-f713-4df2-a7ba-0bcbdb028258" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-0b203c3b-f713-4df2-a7ba-0bcbdb028258" released by "_delete_snapshot" :: held 1.470s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" released by "delete_snapshot" :: held 1.495s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Created reservations ['341f48d1-13e3-46d4-bd1d-26506bde93f3', 'b3e06db8-7bfd-4eb3-abfc-af2a019e92ae', '434f1bda-d757-45b9-91b7-7efffc0fe727', 'cb5e4e34-f606-4937-b7c6-65d1a2458abc'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Delete snapshot completed successfully. Sep 28 18:31:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-65ca749a-bb4c-4d72-8bf5-30a04fc5a650 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-0b203c3b-f713-4df2-a7ba-0bcbdb028258-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-24e35e9a-ffbe-4074-acfa-b10c7e48fe61-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-24e35e9a-ffbe-4074-acfa-b10c7e48fe61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-24e35e9a-ffbe-4074-acfa-b10c7e48fe61" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-24e35e9a-ffbe-4074-acfa-b10c7e48fe61" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Deleting offline snapshot 24e35e9a-ffbe-4074-acfa-b10c7e48fe61 of volume a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] snapshot_file for this snap is: volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed1c04-76bc-4f54-b839-0704a6c2bff5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:31:09 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.392s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e481be-7caa-43a2-ad23-9c4955a6a671]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd Sep 28 18:31:10 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:10 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" returned: 0 in 0.360s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:31:10 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:10 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.333s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61 Sep 28 18:31:10 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:10 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd.24e35e9a-ffbe-4074-acfa-b10c7e48fe61" returned: 0 in 0.242s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-24e35e9a-ffbe-4074-acfa-b10c7e48fe61" released by "_delete_snapshot" :: held 1.441s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" released by "delete_snapshot" :: held 1.465s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Created reservations ['2b8cc8fb-84b2-4ebd-9383-3556ce39927c', 'bfdb433c-03df-47cc-aaf5-fdb67a34040c', '56f92507-29ad-4a4f-89d3-4d548c60952e', '10da7799-8388-47e5-817f-5e445699c95c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Delete snapshot completed successfully. Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-830d493b-6050-45fd-b543-ae1d0b5dc9c7 tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-24e35e9a-ffbe-4074-acfa-b10c7e48fe61-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f960a3d2-30a0-4ed4-8929-014e67067112]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:11 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd Sep 28 18:31:11 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd Sep 28 18:31:12 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" returned: 0 in 0.264s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-quobyte-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd" released by "delete_volume" :: held 0.724s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Created reservations ['d8d13e9f-5088-4193-a602-55da169256ed', '45807d91-83c4-4193-bba6-037f97175361', '59861d0f-ab06-446b-a013-89b64a048f92', '16c61e03-2f99-423d-add2-e763a50224a8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:31:12 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.263s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Deleted volume successfully. Sep 28 18:31:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-e69464a8-996d-4ea0-9382-f01f3ff1adad tempest-VolumesSnapshotListTestJSON-440707068 None] Lock "cinder-a7bdf425-a29b-4cd6-83a7-b53c44d03ebd-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:22 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:22 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=29,cinder:SELECT=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (2a6637ee-4758-40aa-a209-81db46e4afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135ad84a-050a-4541-8f92-489542ebc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135ad84a-050a-4541-8f92-489542ebc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246793760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:41Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(251e50a3-5375-43e5-afca-b84aead83c00),volume_type_id=251e50a3-5375-43e5-afca-b84aead83c00)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb344c75-f298-4daf-9bdf-957d5f7b8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb344c75-f298-4daf-9bdf-957d5f7b8663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88126c28-5e75-4e54-8627-d15426f80c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88126c28-5e75-4e54-8627-d15426f80c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac', 'volume_name': 'volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceb3aca-fd7f-4bf6-8837-b9058e360960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceb3aca-fd7f-4bf6-8837-b9058e360960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e64365-56e6-4f92-aee2-5dd55bee0d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume 3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac', 'volume_size': 1} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246793760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:41Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(251e50a3-5375-43e5-afca-b84aead83c00),volume_type_id=251e50a3-5375-43e5-afca-b84aead83c00)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Creating volume 3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:41 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:41 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac 1073741824 Sep 28 18:31:41 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (7df0b2b1-aa7e-4a83-a955-45c5eb0d10ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8dd5c-eb8d-4122-b992-03c087dbba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8dd5c-eb8d-4122-b992-03c087dbba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1224892417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a637715-84b8-4ced-8d10-360447d012b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:42Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d596f265-670e-4bc4-b71f-a06dba4b61d4),volume_type_id=d596f265-670e-4bc4-b71f-a06dba4b61d4)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6832d399-7d29-4612-b0cc-27a9e9f4fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6832d399-7d29-4612-b0cc-27a9e9f4fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15632eec-ad0d-4931-9588-252f2cc144d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15632eec-ad0d-4931-9588-252f2cc144d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a637715-84b8-4ced-8d10-360447d012b4', 'volume_name': 'volume-9a637715-84b8-4ced-8d10-360447d012b4', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9555be41-fae1-4dfb-98be-5f8d58fa1300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9555be41-fae1-4dfb-98be-5f8d58fa1300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31439172-1bb9-4726-bc5a-d40d62a7d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume 9a637715-84b8-4ced-8d10-360447d012b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a637715-84b8-4ced-8d10-360447d012b4', 'volume_size': 1} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:42 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac 1073741824" returned: 0 in 0.541s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:42 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac Sep 28 18:31:42 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:42 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1224892417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a637715-84b8-4ced-8d10-360447d012b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:42Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d596f265-670e-4bc4-b71f-a06dba4b61d4),volume_type_id=d596f265-670e-4bc4-b71f-a06dba4b61d4)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Creating volume 9a637715-84b8-4ced-8d10-360447d012b4 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e64365-56e6-4f92-aee2-5dd55bee0d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20e9a2-4d7a-410a-b7d2-638c8a5b571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 1073741824 Sep 28 18:31:42 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac (3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac): created successfully Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20e9a2-4d7a-410a-b7d2-638c8a5b571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (2a6637ee-4758-40aa-a209-81db46e4afd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-16e8e827-dc91-442f-9781-c6bba4bde759 tempest-TestInstancesWithCinderVolumes-282031604 None] Created volume successfully. Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (f9c4ce6b-9b12-432b-bd5a-30fded1a5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0df7e49-c2f4-41b6-a134-74f0b8c16f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0df7e49-c2f4-41b6-a134-74f0b8c16f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1229654164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb074283-c9ec-47c1-b1a1-f16dea899821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:43Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc73297-b6db-483a-965c-6aa45beffa0f),volume_type_id=8fc73297-b6db-483a-965c-6aa45beffa0f)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d723ab4c-7453-482d-b053-6012328a6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d723ab4c-7453-482d-b053-6012328a6694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a88b245-ba82-457e-a3ca-d890277e234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:42 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:31:43 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 1073741824" returned: 0 in 0.547s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a88b245-ba82-457e-a3ca-d890277e234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb074283-c9ec-47c1-b1a1-f16dea899821', 'volume_name': 'volume-eb074283-c9ec-47c1-b1a1-f16dea899821', 'volume_size': 1, 'image_id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1729272132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9da6e5b75f4b4c28b91604e3453d24c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb936f4-c9f5-4158-a40d-57d91d6b13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb936f4-c9f5-4158-a40d-57d91d6b13aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a753289-ba2c-49e0-8d5c-e9dc69b2a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume eb074283-c9ec-47c1-b1a1-f16dea899821: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb074283-c9ec-47c1-b1a1-f16dea899821', 'volume_size': 1, 'image_id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1729272132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9da6e5b75f4b4c28b91604e3453d24c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa/file', 'properties': {}}, 'image_service': } Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Trying to clone eb074283-c9ec-47c1-b1a1-f16dea899821 from image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 Sep 28 18:31:43 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31439172-1bb9-4726-bc5a-d40d62a7d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a637715-84b8-4ced-8d10-360447d012b4', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbaeb5b-ea12-4953-a90c-73723fc93b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume volume-9a637715-84b8-4ced-8d10-360447d012b4 (9a637715-84b8-4ced-8d10-360447d012b4): created successfully Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbaeb5b-ea12-4953-a90c-73723fc93b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (7df0b2b1-aa7e-4a83-a955-45c5eb0d10ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ccee2650-ac0c-4867-9b6d-f682d3be9941 tempest-TestInstancesWithCinderVolumes-282031604 None] Created volume successfully. Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD, size 20.69 MB, duration 2.94 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:31:46 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Image download 20.69 MB at 7.04 MB/s Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8e7ee-6a98-4a4a-8740-1bdc3ab5b211]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:46 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD Sep 28 18:31:46 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:46 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Temporary image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa is fetched for user 010b9b209bed47a7878ac7cf1ddf109c. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a94fcf-568d-4788-87da-b6c3c5d42f57]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:46 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD Sep 28 18:31:46 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:46 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1229654164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb074283-c9ec-47c1-b1a1-f16dea899821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da6e5b75f4b4c28b91604e3453d24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:43Z,use_quota=True,user_id='010b9b209bed47a7878ac7cf1ddf109c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc73297-b6db-483a-965c-6aa45beffa0f),volume_type_id=8fc73297-b6db-483a-965c-6aa45beffa0f)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Creating volume eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:31:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:46 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1073741824 Sep 28 18:31:46 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:47 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1073741824" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:47 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 Sep 28 18:31:47 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:47 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Attempting download of bc45cc1b-6aca-4331-9bd5-0ed069ac78aa ((None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}])) to volume eb074283-c9ec-47c1-b1a1-f16dea899821. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432090c-6973-44d0-a0b2-5013c28dbcb0]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:47 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett Sep 28 18:31:47 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:47 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett" returned: 0 in 0.338s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett Sep 28 18:31:48 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:48 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett" returned: 1 in 0.322s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_sn7wcett' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d387d8ef-08a3-4eb6-943c-c81d4e428341]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD Sep 28 18:31:48 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:48 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] bc45cc1b-6aca-4331-9bd5-0ed069ac78aa was qcow2, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:31:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 Sep 28 18:31:48 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:50 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821" returned: 0 in 1.897s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc45cc1b-6aca-4331-9bd5-0ed069ac78aa_lba5rq4odevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:31:50 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Converted 112.00 MB image at 59.00 MB/s Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:50 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1G Sep 28 18:31:50 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:50 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 1G" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Downloaded image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa ((None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}])) to volume eb074283-c9ec-47c1-b1a1-f16dea899821 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Temporary image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa for user 010b9b209bed47a7878ac7cf1ddf109c is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Marking volume eb074283-c9ec-47c1-b1a1-f16dea899821 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Copying metadata from image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa to eb074283-c9ec-47c1-b1a1-f16dea899821. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Creating volume glance metadata for volume eb074283-c9ec-47c1-b1a1-f16dea899821 backed by image bc45cc1b-6aca-4331-9bd5-0ed069ac78aa with: {'image_id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'image_name': 'tempest-scenario-img--1729272132', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a753289-ba2c-49e0-8d5c-e9dc69b2a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb074283-c9ec-47c1-b1a1-f16dea899821', 'volume_size': 1, 'image_id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1729272132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9da6e5b75f4b4c28b91604e3453d24c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc45cc1b-6aca-4331-9bd5-0ed069ac78aa', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc45cc1b-6aca-4331-9bd5-0ed069ac78aa/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceeb09da-1e37-49ee-983f-39488fd75dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Volume volume-eb074283-c9ec-47c1-b1a1-f16dea899821 (eb074283-c9ec-47c1-b1a1-f16dea899821): created successfully Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceeb09da-1e37-49ee-983f-39488fd75dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Flow 'volume_create_manager' (f9c4ce6b-9b12-432b-bd5a-30fded1a5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ea6c9ceb-5e6f-4332-a1d2-21bff15176e4 tempest-TestInstancesWithCinderVolumes-282031604 None] Created volume successfully. Sep 28 18:31:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-49be3473-83a4-49e5-9b6c-3f24c9ccbd6e req-715030b8-b96e-4778-a482-347b58f4f3c0 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-49be3473-83a4-49e5-9b6c-3f24c9ccbd6e req-715030b8-b96e-4778-a482-347b58f4f3c0 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-49be3473-83a4-49e5-9b6c-3f24c9ccbd6e req-715030b8-b96e-4778-a482-347b58f4f3c0 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-49be3473-83a4-49e5-9b6c-3f24c9ccbd6e req-715030b8-b96e-4778-a482-347b58f4f3c0 tempest-TestInstancesWithCinderVolumes-282031604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-eb074283-c9ec-47c1-b1a1-f16dea899821', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc6462ee-5d83-47b9-816b-d6fe8f863696', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:31:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-49be3473-83a4-49e5-9b6c-3f24c9ccbd6e req-715030b8-b96e-4778-a482-347b58f4f3c0 tempest-TestInstancesWithCinderVolumes-282031604 None] attachment_update completed successfully. Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:00 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:32:00 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:00 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:32:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:32:03 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:03 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=15,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f6e12f74-f7fd-4c4f-b358-9d60c8a57e17 req-0a3da8bf-6220-4bd6-aa40-5bc3545a7c92 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f6e12f74-f7fd-4c4f-b358-9d60c8a57e17 req-0a3da8bf-6220-4bd6-aa40-5bc3545a7c92 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-f6e12f74-f7fd-4c4f-b358-9d60c8a57e17 req-0a3da8bf-6220-4bd6-aa40-5bc3545a7c92 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-f6e12f74-f7fd-4c4f-b358-9d60c8a57e17 req-0a3da8bf-6220-4bd6-aa40-5bc3545a7c92 tempest-TestInstancesWithCinderVolumes-282031604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e452fb19-0171-4529-8c6b-28abcb020941', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:32:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-f6e12f74-f7fd-4c4f-b358-9d60c8a57e17 req-0a3da8bf-6220-4bd6-aa40-5bc3545a7c92 tempest-TestInstancesWithCinderVolumes-282031604 None] attachment_update completed successfully. Sep 28 18:32:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eb90643a-219a-4aa4-b954-8b666bfa8c13 req-19c363d1-cf5b-4a1a-ac61-a44e342ff5f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eb90643a-219a-4aa4-b954-8b666bfa8c13 req-19c363d1-cf5b-4a1a-ac61-a44e342ff5f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-eb90643a-219a-4aa4-b954-8b666bfa8c13 req-19c363d1-cf5b-4a1a-ac61-a44e342ff5f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-eb90643a-219a-4aa4-b954-8b666bfa8c13 req-19c363d1-cf5b-4a1a-ac61-a44e342ff5f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-9a637715-84b8-4ced-8d10-360447d012b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6d4344d-812e-4af2-b6f7-4cec3a2aea9f', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:32:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-eb90643a-219a-4aa4-b954-8b666bfa8c13 req-19c363d1-cf5b-4a1a-ac61-a44e342ff5f2 tempest-TestInstancesWithCinderVolumes-282031604 None] attachment_update completed successfully. Sep 28 18:32:34 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-28f1d15d-5d25-4fd2-8499-05757ef98ece req-e1a5ae1f-9f25-4ce2-98e6-9be6d97de9f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Terminate volume connection completed successfully. Sep 28 18:32:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-28f1d15d-5d25-4fd2-8499-05757ef98ece req-e1a5ae1f-9f25-4ce2-98e6-9be6d97de9f2 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleting attachment e452fb19-0171-4529-8c6b-28abcb020941. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-quobyte-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea77f7c-48b0-4226-935d-374eb357e0bd]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:35 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac Sep 28 18:32:35 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" returned: 0 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:36 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac Sep 28 18:32:36 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" returned: 0 in 0.304s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac" released by "delete_volume" :: held 0.768s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:36 devstack cinder-volume[86560]: WARNING cinder.quota [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1895840627-14826689 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1895840627-14826689, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:36 devstack cinder-volume[86560]: WARNING cinder.quota [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1895840627-14826689 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1895840627-14826689, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Created reservations ['9a40396c-2993-45bd-97ae-e81ab224551f', 'd78911e4-4cbd-4f0c-8c9a-211a049c5858', 'a569f4e5-ff10-4d54-92c9-6f8d6f83c358', '14096197-fefb-4723-b2fd-d5538786e686'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:36 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:32:36 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.309s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleted volume successfully. Sep 28 18:32:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-31fb6a7e-8b1b-4c1a-8fbb-a0f8062a2032 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-3f4bdd69-b3e9-44b7-bfdc-ebf7032d29ac-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-15a21b77-e24e-409f-a0ca-d14bff4238c4 req-73cd8e64-878a-4554-a833-3fb95b69b581 tempest-TestInstancesWithCinderVolumes-282031604 None] Terminate volume connection completed successfully. Sep 28 18:32:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-15a21b77-e24e-409f-a0ca-d14bff4238c4 req-73cd8e64-878a-4554-a833-3fb95b69b581 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleting attachment e6d4344d-812e-4af2-b6f7-4cec3a2aea9f. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-9a637715-84b8-4ced-8d10-360447d012b4-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-9a637715-84b8-4ced-8d10-360447d012b4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-quobyte-9a637715-84b8-4ced-8d10-360447d012b4" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-9a637715-84b8-4ced-8d10-360447d012b4" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab894434-96af-493a-b62c-fa602b5b84e9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:40 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 Sep 28 18:32:40 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:40 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4" returned: 0 in 0.430s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:40 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4 Sep 28 18:32:40 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:41 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a637715-84b8-4ced-8d10-360447d012b4" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-9a637715-84b8-4ced-8d10-360447d012b4" released by "delete_volume" :: held 0.742s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:41 devstack cinder-volume[86560]: WARNING cinder.quota [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119906860-1679446468 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119906860-1679446468, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:41 devstack cinder-volume[86560]: WARNING cinder.quota [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119906860-1679446468 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119906860-1679446468, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Created reservations ['2145d0eb-7d30-4686-b509-d18765221023', '7a4da6ea-76e7-4de2-b3ed-37cd24283399', '966d62f9-8f54-48d2-bb8f-738f57e9d924', '7875eadb-0ada-448f-919c-5e8824c2dbae'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:41 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:32:41 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:41 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleted volume successfully. Sep 28 18:32:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a1bf59e0-9e44-49f2-833f-1755b0a32746 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-9a637715-84b8-4ced-8d10-360447d012b4-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-6f555a3a-0036-49cf-b42f-bc501d84f431 req-92b5924c-1aba-42ae-8ead-9c51736d7cc2 tempest-TestInstancesWithCinderVolumes-282031604 None] Terminate volume connection completed successfully. Sep 28 18:32:44 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-6f555a3a-0036-49cf-b42f-bc501d84f431 req-92b5924c-1aba-42ae-8ead-9c51736d7cc2 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleting attachment cc6462ee-5d83-47b9-816b-d6fe8f863696. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-eb074283-c9ec-47c1-b1a1-f16dea899821-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-eb074283-c9ec-47c1-b1a1-f16dea899821-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "cinder-quobyte-eb074283-c9ec-47c1-b1a1-f16dea899821" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-eb074283-c9ec-47c1-b1a1-f16dea899821" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ec726-5f53-46b2-8714-f0bf303c38cf]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:45 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 Sep 28 18:32:45 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:46 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:46 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821 Sep 28 18:32:46 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:46 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eb074283-c9ec-47c1-b1a1-f16dea899821" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-quobyte-eb074283-c9ec-47c1-b1a1-f16dea899821" released by "delete_volume" :: held 0.709s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:46 devstack cinder-volume[86560]: WARNING cinder.quota [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046475000-145571469 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046475000-145571469, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:46 devstack cinder-volume[86560]: WARNING cinder.quota [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046475000-145571469 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046475000-145571469, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Created reservations ['b07ce7c2-497b-499b-ae10-7329acdc6e75', '4cd5a333-83af-45cf-91cf-ff0f51ae31bc', 'c9b6403b-0954-4c28-bc69-26a97deb6bdc', '153a996c-3d91-4860-b3c6-ec899172701c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:46 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:32:46 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:46 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Deleted volume successfully. Sep 28 18:32:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-34c76def-9275-4f15-afc1-92c515597695 tempest-TestInstancesWithCinderVolumes-282031604 None] Lock "cinder-eb074283-c9ec-47c1-b1a1-f16dea899821-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:56 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:56 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:00 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:33:00 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:00 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.240s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:33:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Flow 'volume_create_manager' (d774e36e-2341-4224-8c54-3974352205ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439f882f-4f8d-42e3-bf49-8b7cd0d6d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439f882f-4f8d-42e3-bf49-8b7cd0d6d3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1331956521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25809081-1163-458d-9524-2454d118929f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722730f102b34618a91f9b7d7b2ceba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:26Z,use_quota=True,user_id='9d473b3fe32d4616b1a048dba89de30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9131f1-bf79-4366-aa1b-5fb87e043a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9131f1-bf79-4366-aa1b-5fb87e043a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d0c82d-3d7a-4b39-9986-19da419abfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d0c82d-3d7a-4b39-9986-19da419abfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25809081-1163-458d-9524-2454d118929f', 'volume_name': 'volume-25809081-1163-458d-9524-2454d118929f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56c22e7-1f6c-4192-9dec-103cb849bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56c22e7-1f6c-4192-9dec-103cb849bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5265ac94-be89-475a-8281-1c26949ee145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume 25809081-1163-458d-9524-2454d118929f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25809081-1163-458d-9524-2454d118929f', 'volume_size': 1} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1331956521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25809081-1163-458d-9524-2454d118929f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722730f102b34618a91f9b7d7b2ceba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:26Z,use_quota=True,user_id='9d473b3fe32d4616b1a048dba89de30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Creating volume 25809081-1163-458d-9524-2454d118929f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:33:26 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:26 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f 1073741824 Sep 28 18:33:26 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Flow 'volume_create_manager' (0c4d2ea0-760e-4d42-86e1-4c29dceff811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c9a339-b6a1-4b58-8993-41f47822d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c9a339-b6a1-4b58-8993-41f47822d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-253042222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ef6ecd-7e25-4f66-b612-b7825c034d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722730f102b34618a91f9b7d7b2ceba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:26Z,use_quota=True,user_id='9d473b3fe32d4616b1a048dba89de30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa6680-32bd-41d3-9d3f-f96463005e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa6680-32bd-41d3-9d3f-f96463005e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6b727-bf7d-44aa-8f61-bcfe81efac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6b727-bf7d-44aa-8f61-bcfe81efac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ef6ecd-7e25-4f66-b612-b7825c034d4f', 'volume_name': 'volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a786a1f-49a6-4f47-a220-9ad83a50d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a786a1f-49a6-4f47-a220-9ad83a50d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca7462a-1c51-429c-a24d-4936e00b9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume 95ef6ecd-7e25-4f66-b612-b7825c034d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f', 'volume_size': 1} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:26 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f 1073741824" returned: 0 in 0.545s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:26 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f Sep 28 18:33:26 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:27 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f" returned: 0 in 0.273s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-253042222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ef6ecd-7e25-4f66-b612-b7825c034d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722730f102b34618a91f9b7d7b2ceba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:26Z,use_quota=True,user_id='9d473b3fe32d4616b1a048dba89de30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Creating volume 95ef6ecd-7e25-4f66-b612-b7825c034d4f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:33:27 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5265ac94-be89-475a-8281-1c26949ee145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25809081-1163-458d-9524-2454d118929f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65614231-299c-4d07-bde9-59808ff1f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:27 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f 1073741824 Sep 28 18:33:27 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume volume-25809081-1163-458d-9524-2454d118929f (25809081-1163-458d-9524-2454d118929f): created successfully Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65614231-299c-4d07-bde9-59808ff1f493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Flow 'volume_create_manager' (d774e36e-2341-4224-8c54-3974352205ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b4e927f7-2847-43fc-b134-86e27c5d0e6e tempest-TestServerVolumeAttachmentScenario-1013187951 None] Created volume successfully. Sep 28 18:33:27 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f 1073741824" returned: 0 in 0.489s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:27 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f Sep 28 18:33:27 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:27 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca7462a-1c51-429c-a24d-4936e00b9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5695bf33-5b89-4f01-a93a-82db0fe0f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Volume volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f (95ef6ecd-7e25-4f66-b612-b7825c034d4f): created successfully Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5695bf33-5b89-4f01-a93a-82db0fe0f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Flow 'volume_create_manager' (0c4d2ea0-760e-4d42-86e1-4c29dceff811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:27 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c870cc0e-fa05-4dc0-947c-d6c17c390535 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Created volume successfully. Sep 28 18:33:43 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:43 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9d18404b-1cd1-4a4c-8cd8-cb955be063c9 req-82ff5578-38e3-44bd-8aaf-b16f75d94d02 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9d18404b-1cd1-4a4c-8cd8-cb955be063c9 req-82ff5578-38e3-44bd-8aaf-b16f75d94d02 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-9d18404b-1cd1-4a4c-8cd8-cb955be063c9 req-82ff5578-38e3-44bd-8aaf-b16f75d94d02 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-9d18404b-1cd1-4a4c-8cd8-cb955be063c9 req-82ff5578-38e3-44bd-8aaf-b16f75d94d02 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-25809081-1163-458d-9524-2454d118929f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a964efba-da4c-427a-ad0f-87369b92f416', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:33:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-9d18404b-1cd1-4a4c-8cd8-cb955be063c9 req-82ff5578-38e3-44bd-8aaf-b16f75d94d02 tempest-TestServerVolumeAttachmentScenario-1013187951 None] attachment_update completed successfully. Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:00 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:34:00 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:00 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:34:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:34:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-2bd62de7-fefa-4ffe-961f-c139a925d3fd req-c1bc8aa1-27f8-4203-9451-f6551c2b55a7 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-2bd62de7-fefa-4ffe-961f-c139a925d3fd req-c1bc8aa1-27f8-4203-9451-f6551c2b55a7 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-2bd62de7-fefa-4ffe-961f-c139a925d3fd req-c1bc8aa1-27f8-4203-9451-f6551c2b55a7 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-2bd62de7-fefa-4ffe-961f-c139a925d3fd req-c1bc8aa1-27f8-4203-9451-f6551c2b55a7 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '232a7773-5bb1-455a-ace5-92ca55522bd0', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:34:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-2bd62de7-fefa-4ffe-961f-c139a925d3fd req-c1bc8aa1-27f8-4203-9451-f6551c2b55a7 tempest-TestServerVolumeAttachmentScenario-1013187951 None] attachment_update completed successfully. Sep 28 18:34:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-65f9e988-574c-4c7b-be5d-508461d725fb req-65406d16-dad0-420a-ab58-9fdbf109a09b tempest-TestServerVolumeAttachmentScenario-1013187951 None] Terminate volume connection completed successfully. Sep 28 18:34:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-65f9e988-574c-4c7b-be5d-508461d725fb req-65406d16-dad0-420a-ab58-9fdbf109a09b tempest-TestServerVolumeAttachmentScenario-1013187951 None] Deleting attachment 232a7773-5bb1-455a-ace5-92ca55522bd0. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:34:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5d5ace4a-ed45-45e9-95ed-36c69a19a0f0 req-adc0f3f9-d955-4bb1-a29a-6e4f76a4f0dd tempest-TestServerVolumeAttachmentScenario-1013187951 None] Terminate volume connection completed successfully. Sep 28 18:34:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5d5ace4a-ed45-45e9-95ed-36c69a19a0f0 req-adc0f3f9-d955-4bb1-a29a-6e4f76a4f0dd tempest-TestServerVolumeAttachmentScenario-1013187951 None] Deleting attachment a964efba-da4c-427a-ad0f-87369b92f416. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "cinder-95ef6ecd-7e25-4f66-b612-b7825c034d4f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-95ef6ecd-7e25-4f66-b612-b7825c034d4f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "cinder-quobyte-95ef6ecd-7e25-4f66-b612-b7825c034d4f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-quobyte-95ef6ecd-7e25-4f66-b612-b7825c034d4f" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a641e6a8-5d91-4b0d-95be-ceeea146248d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:11 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f Sep 28 18:34:11 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:11 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:11 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f Sep 28 18:34:11 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:11 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-95ef6ecd-7e25-4f66-b612-b7825c034d4f" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-quobyte-95ef6ecd-7e25-4f66-b612-b7825c034d4f" released by "delete_volume" :: held 0.654s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Created reservations ['ae510515-9e6b-4223-b644-69c94c970e3b', '18f2db02-b140-430b-a044-a665550c6034', '57a0b69b-0017-4bc1-abf1-5e4843f5ca8e', '5d25efc2-fbe6-4e89-9b6a-723af75106a5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:11 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:34:11 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:12 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.251s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:34:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Deleted volume successfully. Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b102967f-cd22-460c-bc88-419b376cd329 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-95ef6ecd-7e25-4f66-b612-b7825c034d4f-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "cinder-25809081-1163-458d-9524-2454d118929f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-25809081-1163-458d-9524-2454d118929f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "cinder-quobyte-25809081-1163-458d-9524-2454d118929f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-quobyte-25809081-1163-458d-9524-2454d118929f" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68349f5-01f6-411e-a76b-8b111f293fe4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:12 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f Sep 28 18:34:12 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:12 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:12 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f Sep 28 18:34:12 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:12 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-25809081-1163-458d-9524-2454d118929f" returned: 0 in 0.235s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-quobyte-25809081-1163-458d-9524-2454d118929f" released by "delete_volume" :: held 0.620s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Created reservations ['f588ef5d-68fa-46a2-989a-7eefff45d332', 'd106d199-a7f2-41b8-9eb6-44f51bab1ae6', '461fd045-312f-4942-8ca3-2e197414d307', 'e63adbcd-3308-4ad3-9fa1-6f4bf5d538d7'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:13 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:34:13 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:13 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.241s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:34:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Deleted volume successfully. Sep 28 18:34:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-63f101ce-306b-40a0-b012-28a1c27764a4 tempest-TestServerVolumeAttachmentScenario-1013187951 None] Lock "cinder-25809081-1163-458d-9524-2454d118929f-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:34:23 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:34:23 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=23,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Flow 'volume_create_manager' (6060fca9-fcf4-49b0-9d87-b8a95e28d0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1e841f-f944-4e38-bfa7-3e831ca54d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1e841f-f944-4e38-bfa7-3e831ca54d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1354411156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38de84b9-e4cc-4879-a74a-5898e2e33707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a65ae6fdc643b98915763b4022cd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:34:46Z,use_quota=True,user_id='5a49204060d64c05b575d81a1829b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe472a7-e4f9-4bbd-a285-ba0c431a5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe472a7-e4f9-4bbd-a285-ba0c431a5004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5392bc5a-f3c5-4d6b-b378-d0df863fd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5392bc5a-f3c5-4d6b-b378-d0df863fd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38de84b9-e4cc-4879-a74a-5898e2e33707', 'volume_name': 'volume-38de84b9-e4cc-4879-a74a-5898e2e33707', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96baefa-6e79-4e39-b2ef-24f970de5b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96baefa-6e79-4e39-b2ef-24f970de5b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60fdb92-9a00-4361-9160-b6ae4ae0a9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:46 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Volume 38de84b9-e4cc-4879-a74a-5898e2e33707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38de84b9-e4cc-4879-a74a-5898e2e33707', 'volume_size': 1} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1354411156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38de84b9-e4cc-4879-a74a-5898e2e33707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a65ae6fdc643b98915763b4022cd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:34:46Z,use_quota=True,user_id='5a49204060d64c05b575d81a1829b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Creating volume 38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:34:46 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:46 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 1073741824 Sep 28 18:34:46 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:46 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 1073741824" returned: 0 in 0.475s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:34:46 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:34:46 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:34:46 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:34:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:34:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60fdb92-9a00-4361-9160-b6ae4ae0a9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38de84b9-e4cc-4879-a74a-5898e2e33707', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be36270e-469c-4284-8d4d-83181c66b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:34:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Volume volume-38de84b9-e4cc-4879-a74a-5898e2e33707 (38de84b9-e4cc-4879-a74a-5898e2e33707): created successfully Sep 28 18:34:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be36270e-469c-4284-8d4d-83181c66b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:34:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Flow 'volume_create_manager' (6060fca9-fcf4-49b0-9d87-b8a95e28d0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:34:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5b89369a-5768-4637-9479-3eea7832442d tempest-TestStampPattern-1159313288 None] Created volume successfully. Sep 28 18:34:57 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:34:57 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:00 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:35:00 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:00 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.250s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:35:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:35:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5ec9b585-05da-4cbb-b65a-9258912bc1a6 req-f1a0a98d-4823-4973-b2ea-2f463ace8df0 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5ec9b585-05da-4cbb-b65a-9258912bc1a6 req-f1a0a98d-4823-4973-b2ea-2f463ace8df0 tempest-TestStampPattern-1159313288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-5ec9b585-05da-4cbb-b65a-9258912bc1a6 req-f1a0a98d-4823-4973-b2ea-2f463ace8df0 tempest-TestStampPattern-1159313288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-5ec9b585-05da-4cbb-b65a-9258912bc1a6 req-f1a0a98d-4823-4973-b2ea-2f463ace8df0 tempest-TestStampPattern-1159313288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-38de84b9-e4cc-4879-a74a-5898e2e33707', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '105545bc-ccd7-4ecb-8bcf-119a98a77251', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:35:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-5ec9b585-05da-4cbb-b65a-9258912bc1a6 req-f1a0a98d-4823-4973-b2ea-2f463ace8df0 tempest-TestStampPattern-1159313288 None] attachment_update completed successfully. Sep 28 18:35:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-fe04342b-9976-4a58-8ce1-92378f775849 req-f884ad83-cc94-4d58-832a-91be8f6b7311 tempest-TestStampPattern-1159313288 None] Terminate volume connection completed successfully. Sep 28 18:35:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-fe04342b-9976-4a58-8ce1-92378f775849 req-f884ad83-cc94-4d58-832a-91be8f6b7311 tempest-TestStampPattern-1159313288 None] Deleting attachment 105545bc-ccd7-4ecb-8bcf-119a98a77251. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:35:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Creating offline snapshot 4e263b99-4e3a-4738-8d3a-7273057ccab1 of volume 38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e91adc-7640-4091-934c-99b7feb7af69]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:22 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:35:22 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:22 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.361s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:22 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 1G Sep 28 18:35:22 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:22 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 1G" returned: 0 in 0.398s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38de84b9-e4cc-4879-a74a-5898e2e33707 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:22 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38de84b9-e4cc-4879-a74a-5898e2e33707 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:35:22 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:23 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38de84b9-e4cc-4879-a74a-5898e2e33707 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:23 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 is being set with open permissions: ugo+rw Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:23 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:35:23 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:23 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.243s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:23 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info Sep 28 18:35:23 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:23 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:23 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info is being set with open permissions: ugo+rw Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:23 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info Sep 28 18:35:23 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:23 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.info" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:23 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-09e0f6c2-5b6a-420f-ba27-37e3268d98f5 tempest-TestStampPattern-1159313288 None] Create snapshot completed successfully Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Flow 'volume_create_manager' (acb227ac-b215-401a-a3f1-43888976fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd55399f-9a58-4f28-a5ae-4b325640ac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd55399f-9a58-4f28-a5ae-4b325640ac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1032114801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19d41b6-05bf-433c-bec3-3f986a593178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a65ae6fdc643b98915763b4022cd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e263b99-4e3a-4738-8d3a-7273057ccab1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:35:31Z,use_quota=True,user_id='5a49204060d64c05b575d81a1829b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5834d56b-b0eb-4cab-a9d8-b5425f725215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5834d56b-b0eb-4cab-a9d8-b5425f725215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c8500-aaeb-4a40-8ea9-a208f0fc1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c8500-aaeb-4a40-8ea9-a208f0fc1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e19d41b6-05bf-433c-bec3-3f986a593178', 'volume_name': 'volume-e19d41b6-05bf-433c-bec3-3f986a593178', 'volume_size': 1, 'snapshot_id': '4e263b99-4e3a-4738-8d3a-7273057ccab1'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395888df-3cdd-4a4a-99b9-3fcee10705b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395888df-3cdd-4a4a-99b9-3fcee10705b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7138c445-df10-4b62-8692-b28c63bdc999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Volume e19d41b6-05bf-433c-bec3-3f986a593178: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e19d41b6-05bf-433c-bec3-3f986a593178', 'volume_size': 1, 'snapshot_id': '4e263b99-4e3a-4738-8d3a-7273057ccab1'} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1-e19d41b6-05bf-433c-bec3-3f986a593178" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1-e19d41b6-05bf-433c-bec3-3f986a593178" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Creating volume e19d41b6-05bf-433c-bec3-3f986a593178 from snapshot 4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] snapshot: 4e263b99-4e3a-4738-8d3a-7273057ccab1, volume: e19d41b6-05bf-433c-bec3-3f986a593178, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e751aef-617c-4460-9173-b4afce608aef]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:35:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:31 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:35:31 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:31 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.371s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38de84b9-e4cc-4879-a74a-5898e2e33707(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[88840a28-3750-4d1a-af19-eee6db897931]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:31 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:35:31 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:31 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:35:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:31 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 Sep 28 18:35:31 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:39 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178" returned: 0 in 8.051s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:39 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:35:39 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Converted 1024.00 MB image at 127.17 MB/s Sep 28 18:35:39 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 is being set with open permissions: ugo+rw Sep 28 18:35:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:35:39 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 Sep 28 18:35:39 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:35:40 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" released by "_copy_volume_from_snapshot" :: held 9.227s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1-e19d41b6-05bf-433c-bec3-3f986a593178" released by "_create_volume_from_snapshot" :: held 9.303s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.322s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7138c445-df10-4b62-8692-b28c63bdc999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19d41b6-05bf-433c-bec3-3f986a593178', 'volume_size': 1, 'snapshot_id': '4e263b99-4e3a-4738-8d3a-7273057ccab1'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c239e-624b-4096-8833-8521aef9afec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:35:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Volume volume-e19d41b6-05bf-433c-bec3-3f986a593178 (e19d41b6-05bf-433c-bec3-3f986a593178): created successfully Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c239e-624b-4096-8833-8521aef9afec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:35:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Flow 'volume_create_manager' (acb227ac-b215-401a-a3f1-43888976fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:35:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ee574ca1-23a1-4edc-ad26-7489867e37d7 tempest-TestStampPattern-1159313288 None] Created volume successfully. Sep 28 18:35:50 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:35:50 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:00 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:36:00 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:00 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.228s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:36:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:36:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b66faa99-a261-45cd-9a13-078e192d9899 req-da56df4d-1a5f-4501-bcd5-60b0a77cb3f0 tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b66faa99-a261-45cd-9a13-078e192d9899 req-da56df4d-1a5f-4501-bcd5-60b0a77cb3f0 tempest-TestStampPattern-1159313288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [req-b66faa99-a261-45cd-9a13-078e192d9899 req-da56df4d-1a5f-4501-bcd5-60b0a77cb3f0 tempest-TestStampPattern-1159313288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-b66faa99-a261-45cd-9a13-078e192d9899 req-da56df4d-1a5f-4501-bcd5-60b0a77cb3f0 tempest-TestStampPattern-1159313288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0', 'name': 'volume-e19d41b6-05bf-433c-bec3-3f986a593178', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0305ce88-7fd2-4079-b7fd-b8e242761ff9', 'enforce_multipath': True} {{(pid=86560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:36:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-b66faa99-a261-45cd-9a13-078e192d9899 req-da56df4d-1a5f-4501-bcd5-60b0a77cb3f0 tempest-TestStampPattern-1159313288 None] attachment_update completed successfully. Sep 28 18:36:25 devstack cinder-volume[86560]: INFO cinder.volume.manager [req-a797a02b-f498-4a13-b5cd-f23ff71e1891 req-477953b4-3c07-4150-9962-66f660d98850 tempest-TestStampPattern-1159313288 None] Terminate volume connection completed successfully. Sep 28 18:36:25 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [req-a797a02b-f498-4a13-b5cd-f23ff71e1891 req-477953b4-3c07-4150-9962-66f660d98850 tempest-TestStampPattern-1159313288 None] Deleting attachment 0305ce88-7fd2-4079-b7fd-b8e242761ff9. {{(pid=86560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-e19d41b6-05bf-433c-bec3-3f986a593178-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "cinder-e19d41b6-05bf-433c-bec3-3f986a593178-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e6238-3354-4a02-ac92-cbf781983757]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:29 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 Sep 28 18:36:29 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:29 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178" returned: 0 in 0.343s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:29 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178 Sep 28 18:36:29 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:29 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e19d41b6-05bf-433c-bec3-3f986a593178" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-e19d41b6-05bf-433c-bec3-3f986a593178" released by "delete_volume" :: held 0.646s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Created reservations ['d0924530-2345-4e51-8250-57802e6b9e77', '85a5622b-e3bd-43f6-9a7f-edbc2ed6b886', 'f3e7907e-687c-47c8-95dc-6116d20abc35', '98ae706e-226b-493a-9469-3130043c809b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:29 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:36:29 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:30 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.234s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:36:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Deleted volume successfully. Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0e708c00-c14d-4e44-b739-84b178fc513b tempest-TestStampPattern-1159313288 None] Lock "cinder-e19d41b6-05bf-433c-bec3-3f986a593178-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-4e263b99-4e3a-4738-8d3a-7273057ccab1-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-4e263b99-4e3a-4738-8d3a-7273057ccab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Deleting offline snapshot 4e263b99-4e3a-4738-8d3a-7273057ccab1 of volume 38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] snapshot_file for this snap is: volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2058b96b-4fb6-4497-9edd-463f6bc5c04b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:30 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:36:30 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:31 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.357s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38de84b9-e4cc-4879-a74a-5898e2e33707(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48028d-fd33-44b1-91b1-f7baca123ae1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:31 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:36:31 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:31 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.512s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:31 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:36:31 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:31 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.319s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:31 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1 Sep 28 18:36:31 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:32 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707.4e263b99-4e3a-4738-8d3a-7273057ccab1" returned: 0 in 0.236s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-4e263b99-4e3a-4738-8d3a-7273057ccab1" released by "_delete_snapshot" :: held 1.535s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" released by "delete_snapshot" :: held 1.561s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Created reservations ['b157a32c-3feb-4b1e-a4c5-62ca3e6cd327', '5825541b-487d-4531-8f02-c24baeac7e45', 'e3beeaa9-e102-486c-873c-76e9088f7892', '0d06a0cf-e77e-4dbe-9f0c-825085ee5c6a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:36:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Delete snapshot completed successfully. Sep 28 18:36:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f066767-0c9b-4988-89e8-a68bc7a6b60a tempest-TestStampPattern-1159313288 None] Lock "cinder-4e263b99-4e3a-4738-8d3a-7273057ccab1-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-38de84b9-e4cc-4879-a74a-5898e2e33707-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "cinder-38de84b9-e4cc-4879-a74a-5898e2e33707-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Acquiring lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[71290f47-d0d0-4b61-a2f8-0e6441f1301b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:36 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:36:36 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:36 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.365s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:36 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707 Sep 28 18:36:36 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:36 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-38de84b9-e4cc-4879-a74a-5898e2e33707" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "cinder-quobyte-38de84b9-e4cc-4879-a74a-5898e2e33707" released by "delete_volume" :: held 0.689s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Created reservations ['55c8c739-8662-403e-9319-96bd4ce2cdbe', 'c7001c0f-79e8-4f70-91a6-8170138d6732', 'fd10c1eb-b7b4-4576-85a1-939324a1c275', 'aa9391ec-bb9e-45f8-9e68-f9b66b576eae'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:37 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:36:37 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:37 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.266s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:36:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Deleted volume successfully. Sep 28 18:36:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-8adfd77e-591e-4a2a-9b17-100832ef742a tempest-TestStampPattern-1159313288 None] Lock "cinder-38de84b9-e4cc-4879-a74a-5898e2e33707-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:47 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:36:47 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (e3451137-8553-415f-b4e6-34d9f2a1266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cbf723-2499-4a37-bc25-0a01c6355866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cbf723-2499-4a37-bc25-0a01c6355866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568163412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ed2a99-1a53-4196-aff1-2665c83f4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:49Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44009ad-fa7e-4f2b-bd4d-2c3e95edb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44009ad-fa7e-4f2b-bd4d-2c3e95edb840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffdc7df-b1d4-477c-9a55-6b8e63acd3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffdc7df-b1d4-477c-9a55-6b8e63acd3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ed2a99-1a53-4196-aff1-2665c83f4e8d', 'volume_name': 'volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c35e79-c75a-49c0-963e-23e238362970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c35e79-c75a-49c0-963e-23e238362970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0658b91-e859-49a5-a009-39fe3b3f8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume a4ed2a99-1a53-4196-aff1-2665c83f4e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d', 'volume_size': 1} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568163412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ed2a99-1a53-4196-aff1-2665c83f4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:49Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:48 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:48 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d 1073741824 Sep 28 18:36:48 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:49 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d 1073741824" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:49 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d Sep 28 18:36:49 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:49 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" returned: 0 in 0.241s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0658b91-e859-49a5-a009-39fe3b3f8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77978722-502f-4b9c-86e0-e86e5467e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d (a4ed2a99-1a53-4196-aff1-2665c83f4e8d): created successfully Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77978722-502f-4b9c-86e0-e86e5467e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (e3451137-8553-415f-b4e6-34d9f2a1266f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-59bdc4e7-1628-45c0-ba9e-4aa08cd01d7e tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating offline snapshot 54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 of volume a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b17b5f-e931-48f9-9ac7-4e773afaacb5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:49 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d Sep 28 18:36:49 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:50 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:50 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 1G Sep 28 18:36:50 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:50 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 1G" returned: 0 in 0.377s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:50 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 Sep 28 18:36:50 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:50 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:50 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 is being set with open permissions: ugo+rw Sep 28 18:36:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:50 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 Sep 28 18:36:50 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:51 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:51 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info Sep 28 18:36:51 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:51 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:51 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info is being set with open permissions: ugo+rw Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:51 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info Sep 28 18:36:51 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:51 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.info" returned: 0 in 0.238s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6743c051-4d33-416f-b89c-e1a98f5afb4d tempest-CreateVolumesFromSnapshotTest-2073248503 None] Create snapshot completed successfully Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (7ff6ad62-6a83-4caf-92d3-df251e40127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ac65a-ee6e-4995-a378-a143200b35cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ac65a-ee6e-4995-a378-a143200b35cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011387923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7825301-69a6-4101-80cb-d2b91999e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:52Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efa137f-db73-43df-882d-54f63d33e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efa137f-db73-43df-882d-54f63d33e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76dadc4-5f5c-4b1e-a964-81fb5b11d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76dadc4-5f5c-4b1e-a964-81fb5b11d960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7825301-69a6-4101-80cb-d2b91999e254', 'volume_name': 'volume-d7825301-69a6-4101-80cb-d2b91999e254', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d172562b-9c1c-42f4-9f22-86626978c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d172562b-9c1c-42f4-9f22-86626978c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8bb63-7838-4749-9b39-989630f70fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume d7825301-69a6-4101-80cb-d2b91999e254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7825301-69a6-4101-80cb-d2b91999e254', 'volume_size': 1} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011387923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7825301-69a6-4101-80cb-d2b91999e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:52Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume d7825301-69a6-4101-80cb-d2b91999e254 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:52 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:52 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 1073741824 Sep 28 18:36:52 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (79544ba0-b6e2-4452-a57c-9b7d8e05410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6109916b-683b-4152-8ea4-8d1fd92d5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6109916b-683b-4152-8ea4-8d1fd92d5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875958459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5edf99c-db5e-48b4-873f-e7a06e77cf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebafc863-fa07-4f37-8501-c7112b6dbe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebafc863-fa07-4f37-8501-c7112b6dbe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4da5ed-125a-4620-b5dc-f7c35f757643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4da5ed-125a-4620-b5dc-f7c35f757643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5edf99c-db5e-48b4-873f-e7a06e77cf2d', 'volume_name': 'volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9147d-75ff-4e9a-85a2-32d063fab332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9147d-75ff-4e9a-85a2-32d063fab332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b491f2b-8134-480c-88d8-20988ed396bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:52 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume b5edf99c-db5e-48b4-873f-e7a06e77cf2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d', 'volume_size': 1} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:52 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 1073741824" returned: 0 in 0.503s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:53 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 Sep 28 18:36:53 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (f11b246d-283d-4809-a317-0c2ffcbcc492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6434fd-f3f7-42f2-8eb7-5ecdc9fc285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6434fd-f3f7-42f2-8eb7-5ecdc9fc285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280049301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f0eb08-66be-4faa-a44d-f2655d8bcc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aedd4ac-004e-457e-bfa8-cbb8c43a9ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aedd4ac-004e-457e-bfa8-cbb8c43a9ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbe304-3a21-46d1-939e-631c43555150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbe304-3a21-46d1-939e-631c43555150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f0eb08-66be-4faa-a44d-f2655d8bcc64', 'volume_name': 'volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624545d6-de9b-44c1-b314-f2234b36641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624545d6-de9b-44c1-b314-f2234b36641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8327f265-f51c-4694-bd23-d211c019d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume f1f0eb08-66be-4faa-a44d-f2655d8bcc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64', 'volume_size': 1} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:53 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254" returned: 0 in 0.294s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875958459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5edf99c-db5e-48b4-873f-e7a06e77cf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume b5edf99c-db5e-48b4-873f-e7a06e77cf2d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8bb63-7838-4749-9b39-989630f70fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7825301-69a6-4101-80cb-d2b91999e254', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbd6794-b5ed-45fd-88bd-356b4afc2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d 1073741824 Sep 28 18:36:53 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-d7825301-69a6-4101-80cb-d2b91999e254 (d7825301-69a6-4101-80cb-d2b91999e254): created successfully Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbd6794-b5ed-45fd-88bd-356b4afc2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (7ff6ad62-6a83-4caf-92d3-df251e40127e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-51227b5e-6c70-4316-9714-bbb0e171eb2c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (01e415da-bb88-4146-b833-8ab41ab75bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0a13e3-f76e-4366-8995-e0676d720555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0a13e3-f76e-4366-8995-e0676d720555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1305388825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004e9ade-c7d2-42da-a749-e9928860b52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c80b55a-1792-4333-b669-9dcb7d58c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c80b55a-1792-4333-b669-9dcb7d58c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392b9d42-1b05-46e2-80f7-bb1d52c0a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392b9d42-1b05-46e2-80f7-bb1d52c0a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004e9ade-c7d2-42da-a749-e9928860b52b', 'volume_name': 'volume-004e9ade-c7d2-42da-a749-e9928860b52b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fac6c9-da85-471b-8d8c-98b6e6807e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fac6c9-da85-471b-8d8c-98b6e6807e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d93fc5-9637-412b-a533-e596f3f6d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume 004e9ade-c7d2-42da-a749-e9928860b52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004e9ade-c7d2-42da-a749-e9928860b52b', 'volume_size': 1} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:53 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d 1073741824" returned: 0 in 0.578s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (52aa271b-fa73-4b6a-b1e5-618632bb3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c15ac91-39c8-4f65-af4e-62685c6ee2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c15ac91-39c8-4f65-af4e-62685c6ee2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930837890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc8a93a-7c7a-4569-b874-227fe85e5980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:54Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eab6e23-0f35-4044-a4e8-ff7d18bf6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eab6e23-0f35-4044-a4e8-ff7d18bf6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8bcc3c-6263-4610-90d7-9192aa5bfae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8bcc3c-6263-4610-90d7-9192aa5bfae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc8a93a-7c7a-4569-b874-227fe85e5980', 'volume_name': 'volume-0dc8a93a-7c7a-4569-b874-227fe85e5980', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a3f98f-0a0c-4c8b-95f8-976c46fbd9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a3f98f-0a0c-4c8b-95f8-976c46fbd9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83caf773-044e-42bd-ac7f-bc1948ca9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume 0dc8a93a-7c7a-4569-b874-227fe85e5980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc8a93a-7c7a-4569-b874-227fe85e5980', 'volume_size': 1} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:54 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d Sep 28 18:36:54 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:54 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280049301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f0eb08-66be-4faa-a44d-f2655d8bcc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume f1f0eb08-66be-4faa-a44d-f2655d8bcc64 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:54 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b491f2b-8134-480c-88d8-20988ed396bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecedab85-81ac-4cd6-bfe6-3f8d4d341c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:54 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 1073741824 Sep 28 18:36:54 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:54 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d (b5edf99c-db5e-48b4-873f-e7a06e77cf2d): created successfully Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecedab85-81ac-4cd6-bfe6-3f8d4d341c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (79544ba0-b6e2-4452-a57c-9b7d8e05410d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d872c4b1-e9d7-4a8d-85fd-1a84d5f94fe5 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:54 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 1073741824" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:54 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 Sep 28 18:36:54 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:54 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1305388825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004e9ade-c7d2-42da-a749-e9928860b52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:53Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume 004e9ade-c7d2-42da-a749-e9928860b52b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:54 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8327f265-f51c-4694-bd23-d211c019d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:54 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b 1073741824 Sep 28 18:36:54 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:54 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19409e0-1775-47ff-b76e-6154455e9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 (f1f0eb08-66be-4faa-a44d-f2655d8bcc64): created successfully Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19409e0-1775-47ff-b76e-6154455e9893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (f11b246d-283d-4809-a317-0c2ffcbcc492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0d325fff-a28e-4a57-8c4d-2db18fa11047 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:55 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b 1073741824" returned: 0 in 0.400s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:55 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b Sep 28 18:36:55 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:55 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930837890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc8a93a-7c7a-4569-b874-227fe85e5980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143fdc351b2413c8a40c32b6ecb9a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:36:54Z,use_quota=True,user_id='a0f309e972df4dedbd7be1dd196f1478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Creating volume 0dc8a93a-7c7a-4569-b874-227fe85e5980 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:36:55 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:55 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 1073741824 Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d93fc5-9637-412b-a533-e596f3f6d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004e9ade-c7d2-42da-a749-e9928860b52b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:55 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d15882-cb35-4156-bd27-71c783f4b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-004e9ade-c7d2-42da-a749-e9928860b52b (004e9ade-c7d2-42da-a749-e9928860b52b): created successfully Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d15882-cb35-4156-bd27-71c783f4b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (01e415da-bb88-4146-b833-8ab41ab75bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cbf03ac3-c88f-4041-8fd9-dbd13951f795 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:56 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 1073741824" returned: 0 in 0.523s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:56 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 Sep 28 18:36:56 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:56 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980" returned: 0 in 0.256s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83caf773-044e-42bd-ac7f-bc1948ca9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc8a93a-7c7a-4569-b874-227fe85e5980', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4aebe-0d0d-437e-972b-bb051df03a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:36:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Volume volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 (0dc8a93a-7c7a-4569-b874-227fe85e5980): created successfully Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4aebe-0d0d-437e-972b-bb051df03a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:36:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Flow 'volume_create_manager' (52aa271b-fa73-4b6a-b1e5-618632bb3a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:36:56 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7739b10a-79a8-4de5-91aa-98fc6a68ca15 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created volume successfully. Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-0dc8a93a-7c7a-4569-b874-227fe85e5980-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-0dc8a93a-7c7a-4569-b874-227fe85e5980-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-0dc8a93a-7c7a-4569-b874-227fe85e5980" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-0dc8a93a-7c7a-4569-b874-227fe85e5980" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8b42f8-9b8b-4722-8c99-6cb2912e2e49]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:57 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 Sep 28 18:36:57 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:57 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980" returned: 0 in 0.359s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:57 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980 Sep 28 18:36:57 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:57 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0dc8a93a-7c7a-4569-b874-227fe85e5980" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-0dc8a93a-7c7a-4569-b874-227fe85e5980" released by "delete_volume" :: held 0.648s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['96d28fc4-5649-4fe9-9c11-3b3d4b9e6857', '6a5d7851-2f2c-4e47-9925-826ee4a6f765', '66aef389-b2e8-48f8-ab30-015176588c6b', 'a7d77df5-f28f-4a40-b57e-60bd666a411b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:58 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:36:58 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:58 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.243s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:36:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-aeeedaeb-d78c-4e5a-90a2-ca79d01998e9 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-0dc8a93a-7c7a-4569-b874-227fe85e5980-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-004e9ade-c7d2-42da-a749-e9928860b52b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-004e9ade-c7d2-42da-a749-e9928860b52b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-004e9ade-c7d2-42da-a749-e9928860b52b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-004e9ade-c7d2-42da-a749-e9928860b52b" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc2828-0a9e-4d73-8a5e-de24e27cfc1e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:58 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b Sep 28 18:36:58 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:58 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b" returned: 0 in 0.379s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:58 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b Sep 28 18:36:58 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:59 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-004e9ade-c7d2-42da-a749-e9928860b52b" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-004e9ade-c7d2-42da-a749-e9928860b52b" released by "delete_volume" :: held 0.684s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['2b5179d9-3487-4f2f-9ec1-cd1bf62e3a12', '0c0be0c3-cd3b-488c-a7b2-b2f19a1861f0', '3e5aa57f-b9f7-4c5a-9fa4-3932d05914a8', '3592dbf6-b865-4d55-94d9-ba750511884a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:59 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:36:59 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:36:59 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:36:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ab197704-3550-4db2-b64a-d0f1a23d7958 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-004e9ade-c7d2-42da-a749-e9928860b52b-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-f1f0eb08-66be-4faa-a44d-f2655d8bcc64-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-f1f0eb08-66be-4faa-a44d-f2655d8bcc64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b9a8b-e94a-4476-b63f-2c736ba837b1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:36:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:36:59 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 Sep 28 18:36:59 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:00 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" returned: 0 in 0.370s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:00 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64 Sep 28 18:37:00 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:00 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:00 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:00 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-f1f0eb08-66be-4faa-a44d-f2655d8bcc64" released by "delete_volume" :: held 0.677s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:00 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['7b0663f4-9acf-4077-936a-31fcf9750349', 'c892f6f5-d084-402c-857c-3317e45bb60e', 'a01a90ec-5294-4198-a81f-6e2e17542e67', 'd82bcd03-bc9a-40d1-b12e-625a4be3ddad'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:00 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:00 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:00 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-32991908-7740-46b2-8fbd-e3422361a404 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-f1f0eb08-66be-4faa-a44d-f2655d8bcc64-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-b5edf99c-db5e-48b4-873f-e7a06e77cf2d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-b5edf99c-db5e-48b4-873f-e7a06e77cf2d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a540ba1-1741-4141-a18a-dc93583aab87]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:01 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d Sep 28 18:37:01 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:01 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" returned: 0 in 0.361s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:01 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d Sep 28 18:37:01 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:01 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-b5edf99c-db5e-48b4-873f-e7a06e77cf2d" released by "delete_volume" :: held 0.649s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['f684abf5-de2b-4c99-ba13-1e49a0f4d60c', 'd287adcc-5feb-42c5-a5a2-45a9d3698bbc', '46095d99-a34c-4dd8-8023-db8f558f919e', '2e5c727d-8aa5-4674-b0f0-73c5a8214931'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:01 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:01 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:01 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4baf4108-5458-4586-8a99-e5dfe5f2c2c0 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-b5edf99c-db5e-48b4-873f-e7a06e77cf2d-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-d7825301-69a6-4101-80cb-d2b91999e254-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-d7825301-69a6-4101-80cb-d2b91999e254-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-d7825301-69a6-4101-80cb-d2b91999e254" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-d7825301-69a6-4101-80cb-d2b91999e254" acquired by "delete_volume" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6306b8-b1da-411e-a0fb-2c1c4bae7791]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:02 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 Sep 28 18:37:02 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:02 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254" returned: 0 in 0.354s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:02 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254 Sep 28 18:37:02 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:02 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d7825301-69a6-4101-80cb-d2b91999e254" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-d7825301-69a6-4101-80cb-d2b91999e254" released by "delete_volume" :: held 0.651s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['95232989-bbec-4ce2-9d60-b619aa907b6b', '73cab415-5e52-41b1-9955-daceea92d93d', '0d39b1ca-1e54-4dae-9457-f5d5acb9afdb', '47242766-c364-4fa2-8c31-7cdca2a1c498'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:02 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:02 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:03 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.281s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b9f1e203-69e4-46ff-998d-e01bc69afd9c tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-d7825301-69a6-4101-80cb-d2b91999e254-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleting offline snapshot 54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 of volume a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] snapshot_file for this snap is: volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8abae66-9163-43b7-9625-b7a1258a1987]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:03 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 Sep 28 18:37:03 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:03 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541501f-e155-4b57-818f-bff373f91dfb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:03 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d Sep 28 18:37:03 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:04 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:04 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 Sep 28 18:37:04 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:04 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" returned: 0 in 0.327s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:04 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5 Sep 28 18:37:04 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:04 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d.54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5" released by "_delete_snapshot" :: held 1.442s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" released by "delete_snapshot" :: held 1.465s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['e4a7a407-a145-4be8-a569-76843ea32983', 'd92d1053-1225-48a3-99d1-4e7d8b1bfbf6', 'f29cd428-bc8b-4c66-9214-f6a8851bc0b2', 'd7481b75-ab25-48bb-a022-2e8bffec6b56'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Delete snapshot completed successfully. Sep 28 18:37:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d16ef20b-b2ae-4be7-9c38-5171be4e92d1 tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-54787d5c-ecdc-48c0-b34a-b2cdd6da86b5-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-a4ed2a99-1a53-4196-aff1-2665c83f4e8d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-a4ed2a99-1a53-4196-aff1-2665c83f4e8d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750280e-4411-4c55-8ccf-93335a7a5a62]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:05 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d Sep 28 18:37:05 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:05 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" returned: 0 in 0.391s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:05 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d Sep 28 18:37:05 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:06 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" returned: 0 in 0.259s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-quobyte-a4ed2a99-1a53-4196-aff1-2665c83f4e8d" released by "delete_volume" :: held 0.711s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Created reservations ['0851f800-3aa7-489f-a6cb-4dd3cff0a23e', '6646c5f7-fa58-450d-97f7-6636ec97064f', 'dd8a308a-41a3-4da5-ba49-095b79f2ab3f', '9ed0b11b-a027-4ead-89bd-c9ebd89c0cb8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:06 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:06 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:06 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Deleted volume successfully. Sep 28 18:37:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6c7b8bd2-d6cc-4405-9880-5326a6010eae tempest-CreateVolumesFromSnapshotTest-2073248503 None] Lock "cinder-a4ed2a99-1a53-4196-aff1-2665c83f4e8d-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:16 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=74,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:37:16 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=48,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=9 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (52dce97a-a81c-4595-adfc-0a60a16be7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecfe017-2dbb-4383-9da2-144852b28b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecfe017-2dbb-4383-9da2-144852b28b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762235916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a607a946-007f-4a70-86a9-43165d1a138c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:27Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264d76b6-6b2a-4036-b759-27b31ab731df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264d76b6-6b2a-4036-b759-27b31ab731df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2e6916-65e1-4f21-afa2-63e94f3cfa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2e6916-65e1-4f21-afa2-63e94f3cfa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a607a946-007f-4a70-86a9-43165d1a138c', 'volume_name': 'volume-a607a946-007f-4a70-86a9-43165d1a138c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063a2e9-162e-4d67-95d6-f81ea5f2aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063a2e9-162e-4d67-95d6-f81ea5f2aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1714d843-e62a-4a8b-b576-0e1e2b4626cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume a607a946-007f-4a70-86a9-43165d1a138c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a607a946-007f-4a70-86a9-43165d1a138c', 'volume_size': 1} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762235916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a607a946-007f-4a70-86a9-43165d1a138c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:27Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:27 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:27 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c 1073741824 Sep 28 18:37:27 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (5755eb78-490d-4a85-a5bc-2617eada9e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09745b4c-27d3-4cb6-acf2-2d2b872818e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09745b4c-27d3-4cb6-acf2-2d2b872818e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260690812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4947abb1-84f5-4d95-9c50-a9ed3ece38d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82b6d82-781f-4bb3-b404-390f07a2f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82b6d82-781f-4bb3-b404-390f07a2f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604e1f4-9e71-4fd6-8303-03d6e4deb576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604e1f4-9e71-4fd6-8303-03d6e4deb576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4947abb1-84f5-4d95-9c50-a9ed3ece38d7', 'volume_name': 'volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685aae8c-7ea5-4a56-88f9-aed6aca73c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685aae8c-7ea5-4a56-88f9-aed6aca73c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bc2e3b-d0f1-41d3-a1b6-33114dfc6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Volume 4947abb1-84f5-4d95-9c50-a9ed3ece38d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7', 'volume_size': 1} Sep 28 18:37:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (6d096d57-c03e-4f76-94ad-bbd941812770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba671f1-36ae-41c1-9c13-43b2c876ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba671f1-36ae-41c1-9c13-43b2c876ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410013100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7905996-95cd-4965-be41-339b369bb3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33917da2-961a-4722-9b78-287767f7d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33917da2-961a-4722-9b78-287767f7d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0403fb-6988-46f2-a7fb-c9cdb9e1b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0403fb-6988-46f2-a7fb-c9cdb9e1b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7905996-95cd-4965-be41-339b369bb3e6', 'volume_name': 'volume-f7905996-95cd-4965-be41-339b369bb3e6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6a5de8-cf29-43aa-83c4-0a3132d2fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6a5de8-cf29-43aa-83c4-0a3132d2fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749010a4-88ea-4609-80b9-580e399ea47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Volume f7905996-95cd-4965-be41-339b369bb3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7905996-95cd-4965-be41-339b369bb3e6', 'volume_size': 1} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:28 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c 1073741824" returned: 0 in 0.780s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (982e010f-af35-4623-94d5-1ce73b524f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9f541e-f96e-42d5-8459-92188160eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9f541e-f96e-42d5-8459-92188160eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852576335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db583e7e-f4de-45f0-a4aa-99718bef53a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e82d8e-15a2-46a5-b375-2b811a3244ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e82d8e-15a2-46a5-b375-2b811a3244ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0000de0e-a072-4b80-9e75-8cc08459142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0000de0e-a072-4b80-9e75-8cc08459142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db583e7e-f4de-45f0-a4aa-99718bef53a7', 'volume_name': 'volume-db583e7e-f4de-45f0-a4aa-99718bef53a7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08da50-90f0-410c-be51-54a4f5f4fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08da50-90f0-410c-be51-54a4f5f4fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee269261-3599-4681-9023-83573afdf87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Volume db583e7e-f4de-45f0-a4aa-99718bef53a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db583e7e-f4de-45f0-a4aa-99718bef53a7', 'volume_size': 1} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:28 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c Sep 28 18:37:28 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (433108cd-2caf-423e-ac61-b51baa397fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9952cf-73a5-49f5-8413-b557ff85a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9952cf-73a5-49f5-8413-b557ff85a553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659590687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3710eaa4-0458-4ad2-a049-2a9c728c701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:29Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4531f0-b7de-4735-b8a0-b4858de43399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4531f0-b7de-4735-b8a0-b4858de43399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513f8dbc-87d4-4b74-8e78-0c308e2f52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513f8dbc-87d4-4b74-8e78-0c308e2f52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3710eaa4-0458-4ad2-a049-2a9c728c701b', 'volume_name': 'volume-3710eaa4-0458-4ad2-a049-2a9c728c701b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86c8155-8c89-4ba5-8d87-43f3a63224f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86c8155-8c89-4ba5-8d87-43f3a63224f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a47620-6f38-4669-b906-8728d90c2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Volume 3710eaa4-0458-4ad2-a049-2a9c728c701b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3710eaa4-0458-4ad2-a049-2a9c728c701b', 'volume_size': 1} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:29 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260690812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4947abb1-84f5-4d95-9c50-a9ed3ece38d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Creating volume 4947abb1-84f5-4d95-9c50-a9ed3ece38d7 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:29 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1714d843-e62a-4a8b-b576-0e1e2b4626cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a607a946-007f-4a70-86a9-43165d1a138c', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181a1f29-d82c-4bdd-b900-a0d9f0a08267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 1073741824 Sep 28 18:37:29 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-a607a946-007f-4a70-86a9-43165d1a138c (a607a946-007f-4a70-86a9-43165d1a138c): created successfully Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181a1f29-d82c-4bdd-b900-a0d9f0a08267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (52dce97a-a81c-4595-adfc-0a60a16be7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2c5dd45d-8e64-4235-a996-f5487fa647b5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (7c2fc458-013e-41a7-a3f2-a7de13e6639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd00bdd-085d-4c58-9d77-d9ab96aa2c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd00bdd-085d-4c58-9d77-d9ab96aa2c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35571712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04278f9-733f-4aff-906c-0ed83f89ac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:29Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcf8ead-417b-413e-b284-8a53de973c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcf8ead-417b-413e-b284-8a53de973c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587fe0ba-8b24-44a4-889c-4c705cac47c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587fe0ba-8b24-44a4-889c-4c705cac47c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04278f9-733f-4aff-906c-0ed83f89ac55', 'volume_name': 'volume-b04278f9-733f-4aff-906c-0ed83f89ac55', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bcab73-07e0-4508-8d2b-5073be219911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bcab73-07e0-4508-8d2b-5073be219911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14168f67-a289-4ce0-9df7-1cc1b71f8489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Volume b04278f9-733f-4aff-906c-0ed83f89ac55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04278f9-733f-4aff-906c-0ed83f89ac55', 'volume_size': 1} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:29 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 1073741824" returned: 0 in 0.691s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:29 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 Sep 28 18:37:29 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:30 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410013100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7905996-95cd-4965-be41-339b369bb3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Creating volume f7905996-95cd-4965-be41-339b369bb3e6 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:30 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bc2e3b-d0f1-41d3-a1b6-33114dfc6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:30 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 1073741824 Sep 28 18:37:30 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303639de-e0b4-454c-ac7d-9a14adbb0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Volume volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 (4947abb1-84f5-4d95-9c50-a9ed3ece38d7): created successfully Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303639de-e0b4-454c-ac7d-9a14adbb0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (5755eb78-490d-4a85-a5bc-2617eada9e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4840a0ff-0f07-4970-b5cd-a37457e17115 tempest-CreateVolumesFromImageTest-613243633 None] Created volume successfully. Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Flow 'volume_create_manager' (46c30849-9308-4bc3-be1e-124f85bec1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f405c4-aa65-4c95-9698-6d0d413b4551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f405c4-aa65-4c95-9698-6d0d413b4551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457ad4f-de13-4907-95a6-3a43c4545566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf5696e8473415686e7768e467d8686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:31Z,use_quota=True,user_id='13119de52b05456c8f5120ebe83ca12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0afddc8-15cd-4a2a-86a3-dd2852b455dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0afddc8-15cd-4a2a-86a3-dd2852b455dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b45e871-e301-4b80-bdf0-de624872f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:37:30 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 1073741824" returned: 0 in 0.587s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:30 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 Sep 28 18:37:30 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b45e871-e301-4b80-bdf0-de624872f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3457ad4f-de13-4907-95a6-3a43c4545566', 'volume_name': 'volume-3457ad4f-de13-4907-95a6-3a43c4545566', 'volume_size': 1, 'image_id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53cf2d155e45599d8af2689810274887', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cf5696e8473415686e7768e467d8686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88c22cf1e9cf06b845309163b4c1da036555293db93f2597f8345983ad45b7fe505f179d08462c0d2c0c664a23445901d545f7157700554f4a20a82d616c52b8', 'id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9067494-bb89-414f-9b67-fbf23bf93d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9067494-bb89-414f-9b67-fbf23bf93d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0128f764-ee29-4e7a-9ad5-b39260fec9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Volume 3457ad4f-de13-4907-95a6-3a43c4545566: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3457ad4f-de13-4907-95a6-3a43c4545566', 'volume_size': 1, 'image_id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53cf2d155e45599d8af2689810274887', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cf5696e8473415686e7768e467d8686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88c22cf1e9cf06b845309163b4c1da036555293db93f2597f8345983ad45b7fe505f179d08462c0d2c0c664a23445901d545f7157700554f4a20a82d616c52b8', 'id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c/file', 'properties': {}}, 'image_service': } Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Trying to clone 3457ad4f-de13-4907-95a6-3a43c4545566 from image ae6c15fc-5d1c-4f23-8769-1f76e822877c at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:37:31 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6" returned: 0 in 0.292s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852576335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db583e7e-f4de-45f0-a4aa-99718bef53a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:28Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Creating volume db583e7e-f4de-45f0-a4aa-99718bef53a7 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:31 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:31 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 1073741824 Sep 28 18:37:31 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749010a4-88ea-4609-80b9-580e399ea47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7905996-95cd-4965-be41-339b369bb3e6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3bfbd-4aa9-409c-93b7-3728ce077566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Volume volume-f7905996-95cd-4965-be41-339b369bb3e6 (f7905996-95cd-4965-be41-339b369bb3e6): created successfully Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3bfbd-4aa9-409c-93b7-3728ce077566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (6d096d57-c03e-4f76-94ad-bbd941812770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4fa936f1-0301-477d-a2ba-3483d4db697a tempest-CreateVolumesFromImageTest-613243633 None] Created volume successfully. Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:37:31 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77bfe2b-fac5-4a34-8d23-6ea0294a4ca6]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:31 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:31 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:31 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 1073741824" returned: 0 in 0.550s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:31 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:31 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 Sep 28 18:37:31 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:31 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:31 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Flow 'volume_create_manager' (ed4a1935-8d39-4f10-a4aa-33b2b418477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a193f31-3c58-46f6-b0e4-28261798d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a193f31-3c58-46f6-b0e4-28261798d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8791b66b-a409-4455-9444-56da834fecf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a02d475af541d09be4be73bb44d0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:32Z,use_quota=True,user_id='86d22b0e8b6f428caaa72a8ad5fae3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbc6553-c1fb-414f-afdc-6bc01e7cba35),volume_type_id=1cbc6553-c1fb-414f-afdc-6bc01e7cba35)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91285c47-aeae-4718-92d7-39b710dd627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91285c47-aeae-4718-92d7-39b710dd627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0306441a-0a96-4772-80b8-e03d20c75441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.image.glance [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Creating Keystone auth plugin from conf {{(pid=86560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:37:32 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7" returned: 0 in 0.331s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.026s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659590687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3710eaa4-0458-4ad2-a049-2a9c728c701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:29Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Creating volume 3710eaa4-0458-4ad2-a049-2a9c728c701b {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee269261-3599-4681-9023-83573afdf87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db583e7e-f4de-45f0-a4aa-99718bef53a7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b 1073741824 Sep 28 18:37:32 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf09836-2b65-4cb3-bb35-4d9ded110597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Temporary image ae6c15fc-5d1c-4f23-8769-1f76e822877c is fetched for user 13119de52b05456c8f5120ebe83ca12d. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Volume volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 (db583e7e-f4de-45f0-a4aa-99718bef53a7): created successfully Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf09836-2b65-4cb3-bb35-4d9ded110597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (982e010f-af35-4623-94d5-1ce73b524f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0eaa8d65-c34d-4623-904d-e1807c5906bf tempest-CreateVolumesFromImageTest-613243633 None] Created volume successfully. Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1342fe57-2d42-4818-82dd-dd20986cf95b]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0306441a-0a96-4772-80b8-e03d20c75441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8791b66b-a409-4455-9444-56da834fecf1', 'volume_name': 'volume-8791b66b-a409-4455-9444-56da834fecf1', 'volume_size': 1, 'image_id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40388ce33536f0cadc71b21c55dffc64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85a02d475af541d09be4be73bb44d0cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '299d00843607891ff086f93212b37821759a6774d6417bf4bb1ff0e74182fc8306fb700a3650765a1beb4403dc0a12d085c8e8d41e0d9f741c30d0a0c07c5b6b', 'id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031918a-8814-46a8-a9ee-6f12ccaff581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031918a-8814-46a8-a9ee-6f12ccaff581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:32 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eab442-9cd3-4262-ad8e-e0c50de20ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Volume 8791b66b-a409-4455-9444-56da834fecf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8791b66b-a409-4455-9444-56da834fecf1', 'volume_size': 1, 'image_id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40388ce33536f0cadc71b21c55dffc64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85a02d475af541d09be4be73bb44d0cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '299d00843607891ff086f93212b37821759a6774d6417bf4bb1ff0e74182fc8306fb700a3650765a1beb4403dc0a12d085c8e8d41e0d9f741c30d0a0c07c5b6b', 'id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Trying to clone 8791b66b-a409-4455-9444-56da834fecf1 from image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}]). {{(pid=86560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e66c58-8147-4d31-9342-f0cb1d786be8]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b 1073741824" returned: 0 in 0.530s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:32 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b Sep 28 18:37:32 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:32 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:32 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.361s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35571712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04278f9-733f-4aff-906c-0ed83f89ac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5263600d59dc403f8ab24f3e7d326fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:29Z,use_quota=True,user_id='3c26a26b9c9b4d6a97bdf4c73f6d3556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Creating volume b04278f9-733f-4aff-906c-0ed83f89ac55 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a47620-6f38-4669-b906-8728d90c2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3710eaa4-0458-4ad2-a049-2a9c728c701b', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:32 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131eaca4-2e9b-4701-90af-b92273a69469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:32 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 1073741824 Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:32 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Volume volume-3710eaa4-0458-4ad2-a049-2a9c728c701b (3710eaa4-0458-4ad2-a049-2a9c728c701b): created successfully Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131eaca4-2e9b-4701-90af-b92273a69469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (433108cd-2caf-423e-ac61-b51baa397fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a2cd257b-f762-499c-bd2c-a67ddff71b94 tempest-CreateVolumesFromImageTest-613243633 None] Created volume successfully. Sep 28 18:37:33 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:33 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:33 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Temporary image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 is fetched for user 86d22b0e8b6f428caaa72a8ad5fae3f0. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:37:33 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 1073741824" returned: 0 in 0.447s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ee202-5ebe-4659-8102-55cdb4905d51]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:33 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 Sep 28 18:37:33 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:33 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:33 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:33 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.763s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14168f67-a289-4ce0-9df7-1cc1b71f8489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04278f9-733f-4aff-906c-0ed83f89ac55', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303e4e7-d33a-4d06-9c89-515a281ca738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating offline snapshot 8e4b1b02-713d-4080-bed2-2ccebfdbb75f of volume a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:37:33 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Volume volume-b04278f9-733f-4aff-906c-0ed83f89ac55 (b04278f9-733f-4aff-906c-0ed83f89ac55): created successfully Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303e4e7-d33a-4d06-9c89-515a281ca738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:33 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Flow 'volume_create_manager' (7c2fc458-013e-41a7-a3f2-a7de13e6639e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197159f-1527-4285-8e45-c7e7cd96455e]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-fb4ecf04-6373-419f-a44e-415680b77fe0 tempest-CreateVolumesFromImageTest-613243633 None] Created volume successfully. Sep 28 18:37:33 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c Sep 28 18:37:33 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:33 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:33 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-b04278f9-733f-4aff-906c-0ed83f89ac55-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-b04278f9-733f-4aff-906c-0ed83f89ac55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-quobyte-b04278f9-733f-4aff-906c-0ed83f89ac55" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-b04278f9-733f-4aff-906c-0ed83f89ac55" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4fdc9-b2eb-4009-b450-720399182cae]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:34 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c" returned: 0 in 0.439s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f 1G Sep 28 18:37:34 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 Sep 28 18:37:34 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55" returned: 0 in 0.371s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55 Sep 28 18:37:34 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f 1G" returned: 0 in 0.421s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a607a946-007f-4a70-86a9-43165d1a138c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a607a946-007f-4a70-86a9-43165d1a138c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f Sep 28 18:37:34 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b04278f9-733f-4aff-906c-0ed83f89ac55" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-b04278f9-733f-4aff-906c-0ed83f89ac55" released by "delete_volume" :: held 0.691s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Created reservations ['9d81e4c6-8048-4f08-871e-d142206c999e', '22bdd6c6-6420-42f6-a549-8ab7705aca37', '2c29915f-8191-4011-a7f0-b594c1f7ad4a', '26e10c9e-aa42-49f3-8369-548c5708ecd8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a607a946-007f-4a70-86a9-43165d1a138c -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:34 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f is being set with open permissions: ugo+rw Sep 28 18:37:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:34 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:34 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:34 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f Sep 28 18:37:34 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.273s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Deleted volume successfully. Sep 28 18:37:35 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-188c495a-9080-4ebf-8db4-5fadb0a6bd95 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-b04278f9-733f-4aff-906c-0ed83f89ac55-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-3710eaa4-0458-4ad2-a049-2a9c728c701b-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-3710eaa4-0458-4ad2-a049-2a9c728c701b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:35 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info Sep 28 18:37:35 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-quobyte-3710eaa4-0458-4ad2-a049-2a9c728c701b" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-3710eaa4-0458-4ad2-a049-2a9c728c701b" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdf226-5f7d-4504-8b07-e1547338134f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:35 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b Sep 28 18:37:35 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info" returned: 0 in 0.256s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:35 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info is being set with open permissions: ugo+rw Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:35 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info Sep 28 18:37:35 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b" returned: 0 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:35 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b Sep 28 18:37:35 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.info" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457ad4f-de13-4907-95a6-3a43c4545566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf5696e8473415686e7768e467d8686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:31Z,use_quota=True,user_id='13119de52b05456c8f5120ebe83ca12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Creating volume 3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:35 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:35 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1073741824 Sep 28 18:37:35 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:35 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-49fc9f62-605f-4d91-8d81-2c497870e472 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Create snapshot completed successfully Sep 28 18:37:35 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3710eaa4-0458-4ad2-a049-2a9c728c701b" returned: 0 in 0.249s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-3710eaa4-0458-4ad2-a049-2a9c728c701b" released by "delete_volume" :: held 0.667s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Created reservations ['96556692-6813-4720-a31d-0d6b0b86de7d', '29fb8c2f-c51a-477a-88cd-e00b727f269b', 'c1cf661b-2d9c-4f5d-ab7b-bd8aba6b649a', '8a2434c6-3da6-4ce2-b013-894af7f088d6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:36 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:36 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:36 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1073741824" returned: 0 in 0.494s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:36 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 Sep 28 18:37:36 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-db583e7e-f4de-45f0-a4aa-99718bef53a7-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:36 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.336s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Deleted volume successfully. Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-db583e7e-f4de-45f0-a4aa-99718bef53a7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-edf86714-7682-4a73-84f8-3c479e739ef5 tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-3710eaa4-0458-4ad2-a049-2a9c728c701b-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-quobyte-db583e7e-f4de-45f0-a4aa-99718bef53a7" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-db583e7e-f4de-45f0-a4aa-99718bef53a7" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bcf766-7033-444e-81ff-7933554ecb75]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:36 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566" returned: 0 in 0.330s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8791b66b-a409-4455-9444-56da834fecf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a02d475af541d09be4be73bb44d0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:32Z,use_quota=True,user_id='86d22b0e8b6f428caaa72a8ad5fae3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbc6553-c1fb-414f-afdc-6bc01e7cba35),volume_type_id=1cbc6553-c1fb-414f-afdc-6bc01e7cba35)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Creating volume 8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:36 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:36 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1073741824 Sep 28 18:37:36 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Attempting download of ae6c15fc-5d1c-4f23-8769-1f76e822877c ((None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}])) to volume 3457ad4f-de13-4907-95a6-3a43c4545566. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:37:36 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 Sep 28 18:37:36 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (98278917-af0e-4c92-81d5-ff8619bfb96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8b92d4-a8ed-4a0f-8fc2-ac0f10cd23ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8b92d4-a8ed-4a0f-8fc2-ac0f10cd23ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207982152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e13abef-3ac9-4a60-ad94-e8c604df276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:37Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629d10c-a63d-44f4-8ebc-7af5ca742b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629d10c-a63d-44f4-8ebc-7af5ca742b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c884decf-e023-4121-9269-2ee50e726320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c884decf-e023-4121-9269-2ee50e726320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e13abef-3ac9-4a60-ad94-e8c604df276e', 'volume_name': 'volume-4e13abef-3ac9-4a60-ad94-e8c604df276e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b65f834-b094-4921-94b6-f258a078cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b65f834-b094-4921-94b6-f258a078cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622f620-cee7-4e44-b7c8-39b90dfcb619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:36 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume 4e13abef-3ac9-4a60-ad94-e8c604df276e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e13abef-3ac9-4a60-ad94-e8c604df276e', 'volume_size': 1} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfe89e-8427-44f0-847e-e6104bb47125]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:37 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i Sep 28 18:37:37 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:37 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7" returned: 0 in 0.662s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:37 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7 Sep 28 18:37:37 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (d184772b-d0dc-4399-85d6-2a1a2bfb2296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e47a68-3151-42bb-ac72-390b152f68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:37 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e47a68-3151-42bb-ac72-390b152f68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847253232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1f906-7a29-4604-99dc-884b227af440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:37Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ccb0c2-44d3-43b1-96a4-5901deda18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ccb0c2-44d3-43b1-96a4-5901deda18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bff1c8-fecf-48b0-9abb-7d1492872a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bff1c8-fecf-48b0-9abb-7d1492872a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea1f906-7a29-4604-99dc-884b227af440', 'volume_name': 'volume-eea1f906-7a29-4604-99dc-884b227af440', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b677cb-8f62-4dfa-8018-ae929713bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:37 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b677cb-8f62-4dfa-8018-ae929713bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7335bb75-09b4-4e25-b7c6-236b04d18c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:37 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume eea1f906-7a29-4604-99dc-884b227af440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea1f906-7a29-4604-99dc-884b227af440', 'volume_size': 1} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1073741824" returned: 0 in 0.799s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i" returned: 0 in 0.506s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:37 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 Sep 28 18:37:37 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:37 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-db583e7e-f4de-45f0-a4aa-99718bef53a7" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-db583e7e-f4de-45f0-a4aa-99718bef53a7" released by "delete_volume" :: held 1.097s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:37 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i Sep 28 18:37:37 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Created reservations ['72d34413-0c02-439f-9a44-737990f11f7a', 'b0008a3d-8331-4e77-ac6e-e0620d00a6a2', '88b9e678-b5c1-4bba-9256-428694ef18ba', '3b2eff40-a4f1-4a19-afb2-965f36076004'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:37 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (99a04396-4db8-4ed0-a372-a2d5efc6b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:37 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692ecdec-abb4-497f-80f6-ed56ed85aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1" returned: 0 in 0.440s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207982152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e13abef-3ac9-4a60-ad94-e8c604df276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:37Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume 4e13abef-3ac9-4a60-ad94-e8c604df276e {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:38 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692ecdec-abb4-497f-80f6-ed56ed85aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980370928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb1f6ba-80fb-4938-ab21-c36175a5fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:38Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfc6fa6-a665-4090-ac6f-10557da69919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfc6fa6-a665-4090-ac6f-10557da69919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e 1073741824 Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f75531-616c-4729-946f-3b3401655d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f75531-616c-4729-946f-3b3401655d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb1f6ba-80fb-4938-ab21-c36175a5fb70', 'volume_name': 'volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4467e-4ea9-4140-a187-b8da3f595d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4467e-4ea9-4140-a187-b8da3f595d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbda4322-301d-4887-b313-fc2835e63100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume 2fb1f6ba-80fb-4938-ab21-c36175a5fb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70', 'volume_size': 1} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:38 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i" returned: 1 in 0.642s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae6c15fc-5d1c-4f23-8769-1f76e822877c_gz1bu95i' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9487560-f5c3-452a-9607-57d211f2b0ef]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:38 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Attempting download of 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}])) to volume 8791b66b-a409-4455-9444-56da834fecf1. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (11bdd3cc-8699-465e-8ef4-2efc097bf853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8763e56d-f192-4239-999a-ca656ad99f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8763e56d-f192-4239-999a-ca656ad99f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180515641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a443d80e-8d69-48c0-bd0a-b04402b94cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:38Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e918ac96-ea90-40af-90a6-cfff2b6891c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e918ac96-ea90-40af-90a6-cfff2b6891c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7948beb3-1d61-43ca-aa1d-16b12f51b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7948beb3-1d61-43ca-aa1d-16b12f51b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a443d80e-8d69-48c0-bd0a-b04402b94cef', 'volume_name': 'volume-a443d80e-8d69-48c0-bd0a-b04402b94cef', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce50236-0db0-4cf2-953c-986cac922396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce50236-0db0-4cf2-953c-986cac922396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca93a8-1aa3-4fd8-a4bc-4b08fd533799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume a443d80e-8d69-48c0-bd0a-b04402b94cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a443d80e-8d69-48c0-bd0a-b04402b94cef', 'volume_size': 1} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e9fa81-1bf0-456c-9f8e-51d39931c7b4]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:38 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:38 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.399s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx Sep 28 18:37:38 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:38 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Deleted volume successfully. Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9caab076-45a6-40bd-b02f-85159057f5ea tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-db583e7e-f4de-45f0-a4aa-99718bef53a7-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:38 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:38 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (2911ed28-c99b-45c7-9ae7-08f4fc3349aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b4a071-67a1-4059-9e51-c4f344687dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e 1073741824" returned: 0 in 0.816s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-f7905996-95cd-4965-be41-339b369bb3e6-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b4a071-67a1-4059-9e51-c4f344687dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18310344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e43ed91-1c09-452e-a2ee-d0a3278ba5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:39Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009e89d-9e30-4057-8223-ea35eabaffef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009e89d-9e30-4057-8223-ea35eabaffef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda02f0c-9c46-49e5-8aca-13eda0e9b614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda02f0c-9c46-49e5-8aca-13eda0e9b614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e43ed91-1c09-452e-a2ee-d0a3278ba5c6', 'volume_name': 'volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceb76ed-43f0-48e2-8aad-8d0f4ee9c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceb76ed-43f0-48e2-8aad-8d0f4ee9c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd17c454-6940-4803-943f-ba285d312a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:38 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume 7e43ed91-1c09-452e-a2ee-d0a3278ba5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6', 'volume_size': 1} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx" returned: 0 in 0.543s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:38 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD Sep 28 18:37:38 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-f7905996-95cd-4965-be41-339b369bb3e6-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e Sep 28 18:37:39 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-quobyte-f7905996-95cd-4965-be41-339b369bb3e6" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-f7905996-95cd-4965-be41-339b369bb3e6" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71630e9-a9ba-4398-9108-6f8c86b6a000]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx Sep 28 18:37:39 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 Sep 28 18:37:39 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] ae6c15fc-5d1c-4f23-8769-1f76e822877c was raw, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 Sep 28 18:37:39 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e" returned: 0 in 0.334s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847253232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1f906-7a29-4604-99dc-884b227af440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:37Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume eea1f906-7a29-4604-99dc-884b227af440 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:39 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx" returned: 1 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_abwngysx' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dc0600-b36b-4966-b128-8573558c6ecc]: (4, 'raw') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 1073741824 Sep 28 18:37:39 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622f620-cee7-4e44-b7c8-39b90dfcb619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e13abef-3ac9-4a60-ad94-e8c604df276e', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5bcbfd-91ff-4c12-9086-14bf41c99686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:39 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-4e13abef-3ac9-4a60-ad94-e8c604df276e (4e13abef-3ac9-4a60-ad94-e8c604df276e): created successfully Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5bcbfd-91ff-4c12-9086-14bf41c99686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (98278917-af0e-4c92-81d5-ff8619bfb96f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:39 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:39 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4438fbbf-6cc9-465d-9e61-d42dca6904be tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:39 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6" returned: 0 in 0.470s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6 Sep 28 18:37:39 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566" returned: 0 in 0.599s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae6c15fc-5d1c-4f23-8769-1f76e822877c_2misu84rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:37:39 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:39 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1G Sep 28 18:37:39 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:39 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f7905996-95cd-4965-be41-339b369bb3e6" returned: 0 in 0.334s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-f7905996-95cd-4965-be41-339b369bb3e6" released by "delete_volume" :: held 0.862s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:39 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 1073741824" returned: 0 in 0.606s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:39 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Created reservations ['aae6b7d3-c279-456c-a3c9-62bb16c97487', 'ba840b47-05a6-4ed8-bc34-b239fd92f1b2', 'bdd8b51f-25c7-4dff-a581-2fa66b08835f', '8b8381f0-f2d1-4033-8acf-45d545c59466'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:39 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD Sep 28 18:37:39 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 Sep 28 18:37:40 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:40 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 1G" returned: 0 in 0.369s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Downloaded image ae6c15fc-5d1c-4f23-8769-1f76e822877c ((None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}])) to volume 3457ad4f-de13-4907-95a6-3a43c4545566 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Temporary image ae6c15fc-5d1c-4f23-8769-1f76e822877c for user 13119de52b05456c8f5120ebe83ca12d is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Marking volume 3457ad4f-de13-4907-95a6-3a43c4545566 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Copying metadata from image ae6c15fc-5d1c-4f23-8769-1f76e822877c to 3457ad4f-de13-4907-95a6-3a43c4545566. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Creating volume glance metadata for volume 3457ad4f-de13-4907-95a6-3a43c4545566 backed by image ae6c15fc-5d1c-4f23-8769-1f76e822877c with: {'image_id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '53cf2d155e45599d8af2689810274887', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:37:40 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD" returned: 1 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 was raw, converting to qcow2 {{(pid=86560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 Sep 28 18:37:40 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0128f764-ee29-4e7a-9ad5-b39260fec9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3457ad4f-de13-4907-95a6-3a43c4545566', 'volume_size': 1, 'image_id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53cf2d155e45599d8af2689810274887', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cf5696e8473415686e7768e467d8686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88c22cf1e9cf06b845309163b4c1da036555293db93f2597f8345983ad45b7fe505f179d08462c0d2c0c664a23445901d545f7157700554f4a20a82d616c52b8', 'id': 'ae6c15fc-5d1c-4f23-8769-1f76e822877c', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae6c15fc-5d1c-4f23-8769-1f76e822877c/file', 'properties': {}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f861f6ef-c3b3-44cf-9e3c-c8bba394d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:40 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440" returned: 0 in 0.296s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980370928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb1f6ba-80fb-4938-ab21-c36175a5fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:38Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume 2fb1f6ba-80fb-4938-ab21-c36175a5fb70 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Volume volume-3457ad4f-de13-4907-95a6-3a43c4545566 (3457ad4f-de13-4907-95a6-3a43c4545566): created successfully Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f861f6ef-c3b3-44cf-9e3c-c8bba394d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:40 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 1073741824 Sep 28 18:37:40 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Flow 'volume_create_manager' (46c30849-9308-4bc3-be1e-124f85bec1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7335bb75-09b4-4e25-b7c6-236b04d18c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea1f906-7a29-4604-99dc-884b227af440', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:40 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf48641e-9380-4d75-918d-43e29de9f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-13b92afb-2bd8-492f-8a82-f69732580f53 tempest-VolumeImageDependencyTests-1389368154 None] Created volume successfully. Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.340s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Deleted volume successfully. Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-eea1f906-7a29-4604-99dc-884b227af440 (eea1f906-7a29-4604-99dc-884b227af440): created successfully Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf48641e-9380-4d75-918d-43e29de9f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (d184772b-d0dc-4399-85d6-2a1a2bfb2296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b5f2335b-dc8c-4e09-8214-2fb25ea72914 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-3edeeeb9-ecc0-415d-9de7-628c4104e67b tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-f7905996-95cd-4965-be41-339b369bb3e6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Acquiring lock "cinder-3457ad4f-de13-4907-95a6-3a43c4545566-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "cinder-3457ad4f-de13-4907-95a6-3a43c4545566-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Acquiring lock "cinder-quobyte-3457ad4f-de13-4907-95a6-3a43c4545566" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "cinder-quobyte-3457ad4f-de13-4907-95a6-3a43c4545566" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16aaf2-7de0-4a0e-a63e-72a14f5585b1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 Sep 28 18:37:40 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:40 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1" returned: 0 in 0.657s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2dee261d-cdb4-40d2-9451-fe05f40b9cf4_9uy6xe20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:37:40 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:40 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 1073741824" returned: 0 in 0.602s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:40 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1G Sep 28 18:37:40 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 Sep 28 18:37:41 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-4947abb1-84f5-4d95-9c50-a9ed3ece38d7-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-4947abb1-84f5-4d95-9c50-a9ed3ece38d7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "cinder-quobyte-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:41 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566" returned: 0 in 0.528s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" acquired by "delete_volume" :: waited 0.033s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:41 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566 Sep 28 18:37:41 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faa2d7a-c197-49f0-b389-40b978105828]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" returned: 0 in 0.381s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180515641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a443d80e-8d69-48c0-bd0a-b04402b94cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:38Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume a443d80e-8d69-48c0-bd0a-b04402b94cef {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:41 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:41 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 1G" returned: 0 in 0.482s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Downloaded image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}])) to volume 8791b66b-a409-4455-9444-56da834fecf1 successfully. {{(pid=86560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Temporary image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 for user 86d22b0e8b6f428caaa72a8ad5fae3f0 is deleted. {{(pid=86560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.volume_utils [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Marking volume 8791b66b-a409-4455-9444-56da834fecf1 as bootable. {{(pid=86560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbda4322-301d-4887-b313-fc2835e63100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:41 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef 1073741824 Sep 28 18:37:41 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9d8230-c962-440d-babe-29a9bbcc0dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:41 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 Sep 28 18:37:41 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 (2fb1f6ba-80fb-4938-ab21-c36175a5fb70): created successfully Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9d8230-c962-440d-babe-29a9bbcc0dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (99a04396-4db8-4ed0-a372-a2d5efc6b700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Copying metadata from image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 to 8791b66b-a409-4455-9444-56da834fecf1. {{(pid=86560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Creating volume glance metadata for volume 8791b66b-a409-4455-9444-56da834fecf1 backed by image 2dee261d-cdb4-40d2-9451-fe05f40b9cf4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '40388ce33536f0cadc71b21c55dffc64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:37:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e5694c6a-cfe4-4591-ba13-6052d47e47c5 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:41 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-3457ad4f-de13-4907-95a6-3a43c4545566" returned: 0 in 0.302s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "cinder-quobyte-3457ad4f-de13-4907-95a6-3a43c4545566" released by "delete_volume" :: held 0.888s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eab442-9cd3-4262-ad8e-e0c50de20ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8791b66b-a409-4455-9444-56da834fecf1', 'volume_size': 1, 'image_id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40388ce33536f0cadc71b21c55dffc64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85a02d475af541d09be4be73bb44d0cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '299d00843607891ff086f93212b37821759a6774d6417bf4bb1ff0e74182fc8306fb700a3650765a1beb4403dc0a12d085c8e8d41e0d9f741c30d0a0c07c5b6b', 'id': '2dee261d-cdb4-40d2-9451-fe05f40b9cf4', 'created_at': datetime.datetime(2026, 9, 28, 16, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dee261d-cdb4-40d2-9451-fe05f40b9cf4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6b9a43-3d99-41d7-8043-dd354f2919e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Volume volume-8791b66b-a409-4455-9444-56da834fecf1 (8791b66b-a409-4455-9444-56da834fecf1): created successfully Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6b9a43-3d99-41d7-8043-dd354f2919e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Flow 'volume_create_manager' (ed4a1935-8d39-4f10-a4aa-33b2b418477f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7e7c1f10-5351-47eb-9d9b-53496ec3d85b tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Created volume successfully. Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Created reservations ['68bafa80-051a-426e-957f-fc8e8541c23e', 'd24cb449-9206-4a2d-a5c9-07d6aff22696', '211d3ac9-50d9-40f7-9bda-76a41cda2121', 'd9aa0b83-9964-46fd-83f3-dcc2a7a14725'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:41 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" returned: 0 in 0.519s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7 Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:41 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:41 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:41 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:41 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef 1073741824" returned: 0 in 0.549s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:42 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef Sep 28 18:37:42 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:42 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.277s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Deleted volume successfully. Sep 28 18:37:42 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" returned: 0 in 0.341s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-67b43221-9200-4459-9791-3ac362eea448 tempest-VolumeImageDependencyTests-1389368154 None] Lock "cinder-3457ad4f-de13-4907-95a6-3a43c4545566-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-quobyte-4947abb1-84f5-4d95-9c50-a9ed3ece38d7" released by "delete_volume" :: held 0.917s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Created reservations ['932de59e-3b9b-49f2-868e-4c3d1fe3e9d3', 'f8ea5e91-78eb-4088-856b-249023aa7f23', 'a723b00b-686b-4936-ad10-660c14bf53fb', '18c3aff7-2e9e-4896-83f2-2b9384ae62a8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:42 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef" returned: 0 in 0.282s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.337s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18310344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e43ed91-1c09-452e-a2ee-d0a3278ba5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7719e106db40fca543a4d5ae850231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:39Z,use_quota=True,user_id='d976a348a7d54dc2995473b3f6f14cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Creating volume 7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca93a8-1aa3-4fd8-a4bc-4b08fd533799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a443d80e-8d69-48c0-bd0a-b04402b94cef', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950bc6f8-7410-4d17-a0a5-1e9f938e5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:42 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 1073741824 Sep 28 18:37:42 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-a443d80e-8d69-48c0-bd0a-b04402b94cef (a443d80e-8d69-48c0-bd0a-b04402b94cef): created successfully Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950bc6f8-7410-4d17-a0a5-1e9f938e5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (11bdd3cc-8699-465e-8ef4-2efc097bf853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:42 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:42 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f47070f1-fdd1-4f42-8d8c-e25b5257db6c tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:42 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Deleted volume successfully. Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ff010184-2ebb-406f-a9be-7b91fe63045d tempest-CreateVolumesFromImageTest-613243633 None] Lock "cinder-4947abb1-84f5-4d95-9c50-a9ed3ece38d7-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:42 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 1073741824" returned: 0 in 0.537s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:42 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 Sep 28 18:37:42 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Acquiring lock "cinder-8791b66b-a409-4455-9444-56da834fecf1-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "cinder-8791b66b-a409-4455-9444-56da834fecf1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Acquiring lock "cinder-quobyte-8791b66b-a409-4455-9444-56da834fecf1" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "cinder-quobyte-8791b66b-a409-4455-9444-56da834fecf1" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb64cc-d1c0-4861-bca4-5f0d149b43d5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:43 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 Sep 28 18:37:43 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:43 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" returned: 0 in 0.364s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd17c454-6940-4803-943f-ba285d312a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5e0582-db5b-4cc5-9f55-ffab25f8b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Volume volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 (7e43ed91-1c09-452e-a2ee-d0a3278ba5c6): created successfully Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5e0582-db5b-4cc5-9f55-ffab25f8b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Flow 'volume_create_manager' (2911ed28-c99b-45c7-9ae7-08f4fc3349aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7bee5c81-84c9-416c-a4b3-6e71be6d9584 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created volume successfully. Sep 28 18:37:43 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:43 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1 Sep 28 18:37:43 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:43 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8791b66b-a409-4455-9444-56da834fecf1" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "cinder-quobyte-8791b66b-a409-4455-9444-56da834fecf1" released by "delete_volume" :: held 0.847s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Created reservations ['40241da6-9cd6-4635-9315-e112d96593ef', '42f9af3c-525d-449f-93ba-4d0f49974d96', 'c4a58331-d9eb-486e-b77c-834708bb9f59', '308199b2-beee-4fe4-bc2c-7d95fb44fdf8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:44 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:44 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:44 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.358s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:44 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Deleted volume successfully. Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-dc44827d-3ed3-4035-8d82-9cae0337aaa0 tempest-VolumeAndVolumeTypeFromImageTest-1791993684 None] Lock "cinder-8791b66b-a409-4455-9444-56da834fecf1-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a690ce99-2178-4ba9-8d39-0fe60a7b8370]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:44 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 Sep 28 18:37:44 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:45 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" returned: 0 in 0.540s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:45 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6 Sep 28 18:37:45 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:45 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6" released by "delete_volume" :: held 0.875s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['230ef881-4629-4616-a2bc-14b6fd68e239', '31f5dfea-07c7-49c8-954f-df6c250fe3a1', '482c89d0-0da4-47b9-8e1f-c99997923624', '0a578fd2-5e7f-4f0c-870c-704fe0fc2e7e'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:45 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:45 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-a443d80e-8d69-48c0-bd0a-b04402b94cef-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-a443d80e-8d69-48c0-bd0a-b04402b94cef-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-a443d80e-8d69-48c0-bd0a-b04402b94cef" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:45 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a443d80e-8d69-48c0-bd0a-b04402b94cef" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aded1ff-565f-49f6-a05c-e82396027cc0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:46 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:46 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7f1f8ed4-2e99-4a89-8cc6-fa15aabe0cd8 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-7e43ed91-1c09-452e-a2ee-d0a3278ba5c6-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:46 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef Sep 28 18:37:46 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:46 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef" returned: 0 in 0.529s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:46 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef Sep 28 18:37:46 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:46 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a443d80e-8d69-48c0-bd0a-b04402b94cef" returned: 0 in 0.327s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a443d80e-8d69-48c0-bd0a-b04402b94cef" released by "delete_volume" :: held 0.939s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:46 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['d5327732-d6d1-4ef2-a9df-9015fe8a14f4', '70f8fffe-a408-4d18-92b8-3af4bd2aa3ae', '15c11501-cad5-47fb-ac56-042686fd794b', 'd6c6f873-c2a6-4d98-835c-f1e8843a9d7f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-2fb1f6ba-80fb-4938-ab21-c36175a5fb70-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:47 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:47 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-2fb1f6ba-80fb-4938-ab21-c36175a5fb70-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" acquired by "delete_volume" :: waited 0.042s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Flow 'volume_create_manager' (5efa55ee-7bac-45c5-84f6-124a7f6857c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ce13a-7870-420f-a173-b407b85e0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4250bd1b-ec22-4bd0-af06-bc6df53ce3c0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ce13a-7870-420f-a173-b407b85e0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1776064547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f3104d-da10-430b-84a7-ab5ae318d950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e01598f558644f29ea5c298aaf4e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:47Z,use_quota=True,user_id='d31b53b1f1ea47d9885b3fc6fa4029ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd6c949-d9fa-42f9-9d6e-6a8d0446116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd6c949-d9fa-42f9-9d6e-6a8d0446116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f4c7e-38bc-4d04-bf74-0a54d53492e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f4c7e-38bc-4d04-bf74-0a54d53492e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f3104d-da10-430b-84a7-ab5ae318d950', 'volume_name': 'volume-b1f3104d-da10-430b-84a7-ab5ae318d950', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef8294d-77bc-40b0-bf79-8302bd274d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef8294d-77bc-40b0-bf79-8302bd274d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673da2e-e776-4e21-8b6e-b930c465794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:47 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Volume b1f3104d-da10-430b-84a7-ab5ae318d950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f3104d-da10-430b-84a7-ab5ae318d950', 'volume_size': 1} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1776064547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f3104d-da10-430b-84a7-ab5ae318d950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e01598f558644f29ea5c298aaf4e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:47Z,use_quota=True,user_id='d31b53b1f1ea47d9885b3fc6fa4029ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Creating volume b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:47 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:47 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 Sep 28 18:37:47 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:47 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 1073741824 Sep 28 18:37:47 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:47 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-323b35e2-50a1-416e-8ceb-6df774deea5d tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-a443d80e-8d69-48c0-bd0a-b04402b94cef-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:47 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" returned: 0 in 0.529s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:47 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70 Sep 28 18:37:47 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Flow 'volume_create_manager' (67e1c8a1-008d-4562-8a2c-11540b62f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1b4173-cdfb-471a-9748-31d36cb84049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1b4173-cdfb-471a-9748-31d36cb84049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9547b199-ec61-4f6c-aece-fe2fb3006647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53acb9c651fd493c86a35d6d74401f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:48Z,use_quota=True,user_id='ed42c8b15b1d44548fcce59439211237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dcc023-1734-4819-9c7a-c7327e234518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dcc023-1734-4819-9c7a-c7327e234518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc4356e-27d5-45a4-bf47-62eee566ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc4356e-27d5-45a4-bf47-62eee566ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9547b199-ec61-4f6c-aece-fe2fb3006647', 'volume_name': 'volume-9547b199-ec61-4f6c-aece-fe2fb3006647', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb728b7-ddca-4b49-a130-93be6d6e55eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb728b7-ddca-4b49-a130-93be6d6e55eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb36780-5364-498f-a5a5-7d3e01ead641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Volume 9547b199-ec61-4f6c-aece-fe2fb3006647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9547b199-ec61-4f6c-aece-fe2fb3006647', 'volume_size': 1} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:48 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 1073741824" returned: 0 in 0.722s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:48 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" returned: 0 in 0.332s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-2fb1f6ba-80fb-4938-ab21-c36175a5fb70" released by "delete_volume" :: held 0.946s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:48 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:37:48 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['14acd2b0-e54f-4c09-8afa-10c1ee33044e', '52b4e0e4-b37c-4d60-bfbf-130e3ae6f23e', '3a0d4933-5f02-4380-a7e9-e2fa93483001', '880bf7e8-313c-446f-83b0-ee7ce2cad921'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:48 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:48 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:48 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.310s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9547b199-ec61-4f6c-aece-fe2fb3006647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53acb9c651fd493c86a35d6d74401f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:48Z,use_quota=True,user_id='ed42c8b15b1d44548fcce59439211237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Creating volume 9547b199-ec61-4f6c-aece-fe2fb3006647 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:48 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:48 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 1073741824 Sep 28 18:37:48 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673da2e-e776-4e21-8b6e-b930c465794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f3104d-da10-430b-84a7-ab5ae318d950', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668317ea-526c-4557-a35b-919df06d2bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:48 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Volume volume-b1f3104d-da10-430b-84a7-ab5ae318d950 (b1f3104d-da10-430b-84a7-ab5ae318d950): created successfully Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668317ea-526c-4557-a35b-919df06d2bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Flow 'volume_create_manager' (5efa55ee-7bac-45c5-84f6-124a7f6857c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0db16b77-d2a4-444f-bfe4-a0283782cfdd tempest-VolumeDependencyTests-1139773748 None] Created volume successfully. Sep 28 18:37:48 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.308s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1364aeac-3964-4afd-b2f6-1736fa42a865 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-2fb1f6ba-80fb-4938-ab21-c36175a5fb70-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:49 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 1073741824" returned: 0 in 0.542s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:49 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 Sep 28 18:37:49 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:49 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-eea1f906-7a29-4604-99dc-884b227af440-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647" returned: 0 in 0.349s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-eea1f906-7a29-4604-99dc-884b227af440-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb36780-5364-498f-a5a5-7d3e01ead641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9547b199-ec61-4f6c-aece-fe2fb3006647', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f153e57e-ed07-48a7-b724-8712a1b57356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:49 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Volume volume-9547b199-ec61-4f6c-aece-fe2fb3006647 (9547b199-ec61-4f6c-aece-fe2fb3006647): created successfully Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f153e57e-ed07-48a7-b724-8712a1b57356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Flow 'volume_create_manager' (67e1c8a1-008d-4562-8a2c-11540b62f269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Creating offline snapshot 0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c of volume b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-eea1f906-7a29-4604-99dc-884b227af440" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e90ed85c-ad89-48b1-b650-0eaedd3fd2db tempest-CinderUnicodeTest-1519856101 None] Created volume successfully. Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c432ee5-7ba6-49aa-81e8-770c28843fbe]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-eea1f906-7a29-4604-99dc-884b227af440" acquired by "delete_volume" :: waited 0.049s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135fd94-a5ea-432b-acd3-ff06b52cef4d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:49 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:37:49 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:49 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 Sep 28 18:37:49 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:50 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.469s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:50 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:50 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c 1G Sep 28 18:37:50 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:50 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440 Sep 28 18:37:50 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:50 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-eea1f906-7a29-4604-99dc-884b227af440" returned: 0 in 0.302s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-eea1f906-7a29-4604-99dc-884b227af440" released by "delete_volume" :: held 0.815s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['f28c118f-4bef-4c8c-bc87-1811d0967200', 'b073d8ff-a918-4e07-9fbf-4473918ec860', 'a4ee11e6-55be-4c00-b4ba-9b186d32e8dd', '2c65b83e-afca-412f-a9cc-7f517d298fd4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Flow 'volume_create_manager' (5ca6a2de-59c6-4856-b6da-799d0350af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5e98a-fd7a-4cc1-a4c8-db5b7f751344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5e98a-fd7a-4cc1-a4c8-db5b7f751344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1936619272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e410fcb-7f1f-4cbb-98d6-07a99670107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53acb9c651fd493c86a35d6d74401f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:51Z,use_quota=True,user_id='ed42c8b15b1d44548fcce59439211237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f325d80d-2656-4556-b173-7744c3cc2bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f325d80d-2656-4556-b173-7744c3cc2bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52779282-db51-471f-bde0-6d1713ba9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52779282-db51-471f-bde0-6d1713ba9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e410fcb-7f1f-4cbb-98d6-07a99670107d', 'volume_name': 'volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:50 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0633134-bfef-4df4-83e0-f3c5acd72a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0633134-bfef-4df4-83e0-f3c5acd72a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b86676-0444-4da7-8ef3-31438e097601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Volume 8e410fcb-7f1f-4cbb-98d6-07a99670107d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d', 'volume_size': 1} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c 1G" returned: 0 in 0.705s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f3104d-da10-430b-84a7-ab5ae318d950 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:50 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:50 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:50 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f3104d-da10-430b-84a7-ab5ae318d950 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:37:50 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ba3f5f09-2de1-491f-ac77-468d5bf8a660 tempest-ProjectAdminTests-843079231 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9874877929688, 'free_capacity_gb': 1774.9874877929688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-4e13abef-3ac9-4a60-ad94-e8c604df276e-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-4e13abef-3ac9-4a60-ad94-e8c604df276e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-4e13abef-3ac9-4a60-ad94-e8c604df276e" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-4e13abef-3ac9-4a60-ad94-e8c604df276e" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd638af6-e786-4f26-9ee1-e25255140daa]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:51 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-eec50201-d621-4907-85f8-804ac00beb6e tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-eea1f906-7a29-4604-99dc-884b227af440-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:51 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f3104d-da10-430b-84a7-ab5ae318d950 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.392s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c is being set with open permissions: ugo+rw Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:51 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e Sep 28 18:37:51 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:51 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:37:51 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:51 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e" returned: 0 in 0.418s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:51 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e Sep 28 18:37:51 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:51 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info Sep 28 18:37:51 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:51 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4e13abef-3ac9-4a60-ad94-e8c604df276e" returned: 0 in 0.296s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-4e13abef-3ac9-4a60-ad94-e8c604df276e" released by "delete_volume" :: held 0.774s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:51 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info" returned: 0 in 0.343s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:51 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info is being set with open permissions: ugo+rw Sep 28 18:37:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:51 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info Sep 28 18:37:51 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['15f1c8d3-0663-49f1-a161-a21a6c133abe', '4f6a83ab-465a-46f1-891c-36d402cd6c42', '222dfa00-4ea5-4c0c-a867-28e044ee4064', '70ee0b60-971e-44d6-9598-6a64d2fc29c9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:52 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:52 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-8e4b1b02-713d-4080-bed2-2ccebfdbb75f-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-8e4b1b02-713d-4080-bed2-2ccebfdbb75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-8e4b1b02-713d-4080-bed2-2ccebfdbb75f" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-8e4b1b02-713d-4080-bed2-2ccebfdbb75f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleting offline snapshot 8e4b1b02-713d-4080-bed2-2ccebfdbb75f of volume a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:37:52 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] snapshot_file for this snap is: volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.info" returned: 0 in 0.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad5be62-5b3d-40c0-9393-1526795b23d3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1936619272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e410fcb-7f1f-4cbb-98d6-07a99670107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53acb9c651fd493c86a35d6d74401f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:51Z,use_quota=True,user_id='ed42c8b15b1d44548fcce59439211237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Creating volume 8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:52 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:52 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.332s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:52 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d 1073741824 Sep 28 18:37:52 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:52 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:52 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1469457b-49e5-4caf-be01-c79893861b5f tempest-VolumeDependencyTests-1139773748 None] Create snapshot completed successfully Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb453a3-03a4-43b6-a06f-d96c345339a3 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-4e13abef-3ac9-4a60-ad94-e8c604df276e-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:52 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f Sep 28 18:37:52 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:52 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f" returned: 0 in 0.453s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a607a946-007f-4a70-86a9-43165d1a138c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:37:52 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d 1073741824" returned: 0 in 0.500s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c24e5-019a-4664-ba37-2315658bd92f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:53 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d Sep 28 18:37:53 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:53 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c Sep 28 18:37:53 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:53 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d" returned: 0 in 0.343s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b86676-0444-4da7-8ef3-31438e097601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76971367-8e12-4016-a3dd-bbf0149b1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Volume volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d (8e410fcb-7f1f-4cbb-98d6-07a99670107d): created successfully Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76971367-8e12-4016-a3dd-bbf0149b1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Flow 'volume_create_manager' (5ca6a2de-59c6-4856-b6da-799d0350af69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:53 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ed4ea1ed-7e58-469c-98c6-fd6c1b78bf98 tempest-CinderUnicodeTest-1519856101 None] Created volume successfully. Sep 28 18:37:53 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c" returned: 0 in 0.505s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:53 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f Sep 28 18:37:53 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Flow 'volume_create_manager' (8d5d316f-6ca7-42d1-9f2c-56a85d8d7178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4193aa75-0260-4f14-a00b-1cc6bab48d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4193aa75-0260-4f14-a00b-1cc6bab48d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1991972972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a980c08-eabc-4d73-9aa2-ca72320a76b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e01598f558644f29ea5c298aaf4e9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:54Z,use_quota=True,user_id='d31b53b1f1ea47d9885b3fc6fa4029ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5d5a18-06b4-451f-8010-37474b699665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5d5a18-06b4-451f-8010-37474b699665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5f8043-2230-4595-ac18-798fac7997be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5f8043-2230-4595-ac18-798fac7997be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a980c08-eabc-4d73-9aa2-ca72320a76b1', 'volume_name': 'volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1', 'volume_size': 1, 'snapshot_id': '0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b0b6a-3834-4b01-8d8b-d3d4d6b738c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b0b6a-3834-4b01-8d8b-d3d4d6b738c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae40fd-3988-407a-bfaa-989c642aa42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Volume 9a980c08-eabc-4d73-9aa2-ca72320a76b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1', 'volume_size': 1, 'snapshot_id': '0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c'} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-9a980c08-eabc-4d73-9aa2-ca72320a76b1" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:53 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f Sep 28 18:37:53 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-9a980c08-eabc-4d73-9aa2-ca72320a76b1" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Creating volume 9a980c08-eabc-4d73-9aa2-ca72320a76b1 from snapshot 0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] snapshot: 0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c, volume: 9a980c08-eabc-4d73-9aa2-ca72320a76b1, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a89e7-310d-4827-8e53-faaa0bf2110b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:54 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:37:54 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:54 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c.8e4b1b02-713d-4080-bed2-2ccebfdbb75f" returned: 0 in 0.281s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-8e4b1b02-713d-4080-bed2-2ccebfdbb75f" released by "_delete_snapshot" :: held 1.902s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" released by "delete_snapshot" :: held 1.943s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['5af860ac-dc9e-4ade-ba41-a586ec2731ac', '511bcd4d-1b3a-4164-8efd-7d5819191805', '89c30fcf-f167-4f99-acaf-b8868bdb6bba', '69ea57b9-22f1-40bf-ab47-a31f9c41395c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:54 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Delete snapshot completed successfully. Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-07c5bd45-7eb1-4b1e-bdcb-ba49691b9adf tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-8e4b1b02-713d-4080-bed2-2ccebfdbb75f-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:54 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.480s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f3104d-da10-430b-84a7-ab5ae318d950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-a607a946-007f-4a70-86a9-43165d1a138c-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ce700-cb36-47f1-812c-b529a39dac9f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-a607a946-007f-4a70-86a9-43165d1a138c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:37:54 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:37:54 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a4874-844c-49da-a511-a008b9a3191f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:54 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c Sep 28 18:37:54 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:54 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.432s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:37:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:54 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 Sep 28 18:37:54 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:55 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c" returned: 0 in 0.408s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:55 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c Sep 28 18:37:55 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:55 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a607a946-007f-4a70-86a9-43165d1a138c" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-quobyte-a607a946-007f-4a70-86a9-43165d1a138c" released by "delete_volume" :: held 0.792s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Created reservations ['c66738d8-6762-442e-8093-3bcc94e7a06d', '513a5417-e4ab-4bc9-be25-7ef1bd32debe', 'ec718d67-5052-49f4-8470-795a09691c8c', '175e40b9-f128-4314-847c-16db81956950'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:37:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:37:55 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:37:55 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:37:56 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.404s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:37:56 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Deleted volume successfully. Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6f9394c4-5eb2-450c-b8a0-e46f430a0ff0 tempest-CreateVolumesFromSnapshotTest-1112779069 None] Lock "cinder-a607a946-007f-4a70-86a9-43165d1a138c-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (a5de063b-866c-4c6c-a536-ca0dc61fa370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921bc85d-9b03-4ab0-a293-a05eb6745b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921bc85d-9b03-4ab0-a293-a05eb6745b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572381740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b9718b-f026-48b7-b52b-1d69faefe2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:56Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a772a6cd-b0ca-4831-850b-0fdb1c1462c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a772a6cd-b0ca-4831-850b-0fdb1c1462c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a4ac7-1df4-4430-8276-7901e4f81d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a4ac7-1df4-4430-8276-7901e4f81d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b9718b-f026-48b7-b52b-1d69faefe2d5', 'volume_name': 'volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5842c05-0cd9-4673-9726-40ea380f8f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5842c05-0cd9-4673-9726-40ea380f8f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59121edf-c540-4184-9557-0ed1b94b5826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:37:56 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Volume f1b9718b-f026-48b7-b52b-1d69faefe2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5', 'volume_size': 1} Sep 28 18:37:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:00 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:00 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:00 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.497s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:38:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (7b98764c-8db1-4190-acee-3b4821ca8d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd32ef6a-e338-47be-b255-324d824bbcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd32ef6a-e338-47be-b255-324d824bbcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062478881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:01Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125799e5-9574-4258-a972-0da0537439da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125799e5-9574-4258-a972-0da0537439da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d085f8a-c844-4a26-963f-2e6a3fc21d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d085f8a-c844-4a26-963f-2e6a3fc21d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f', 'volume_name': 'volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6368e622-09ac-4809-b582-9d4d77c6a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6368e622-09ac-4809-b582-9d4d77c6a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1648d5d3-3189-4559-9180-d67d9b924de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume 8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f', 'volume_size': 1} Sep 28 18:38:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:02 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1" returned: 0 in 7.633s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950, size 1024.00 MB, duration 7.63 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:38:02 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Converted 1024.00 MB image at 134.14 MB/s Sep 28 18:38:02 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 is being set with open permissions: ugo+rw Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:02 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 Sep 28 18:38:02 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:02 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" released by "_copy_volume_from_snapshot" :: held 8.922s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-9a980c08-eabc-4d73-9aa2-ca72320a76b1" released by "_create_volume_from_snapshot" :: held 8.997s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.020s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.311s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Creating offline snapshot 19bfe4af-093f-4b6f-84f1-21c25d238e56 of volume 8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae40fd-3988-407a-bfaa-989c642aa42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1', 'volume_size': 1, 'snapshot_id': '0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c4e347-3052-4dd2-a2fe-fb01f1e35558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa464c31-a19d-4072-8bcd-db58c6cb5b52]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:02 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Volume volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 (9a980c08-eabc-4d73-9aa2-ca72320a76b1): created successfully Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c4e347-3052-4dd2-a2fe-fb01f1e35558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:02 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Flow 'volume_create_manager' (8d5d316f-6ca7-42d1-9f2c-56a85d8d7178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-836c517c-3141-48d6-9ea7-8266751c8629 tempest-VolumeDependencyTests-1139773748 None] Created volume successfully. Sep 28 18:38:03 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d Sep 28 18:38:03 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:03 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d" returned: 0 in 0.388s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:03 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 1G Sep 28 18:38:03 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:03 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 1G" returned: 0 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:03 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 Sep 28 18:38:03 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Deleting offline snapshot 0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c of volume b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] snapshot_file for this snap is: volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed48f9a-8c60-49ca-a70c-4dd6fdf642e8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:03 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:38:03 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56" returned: 0 in 0.302s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 is being set with open permissions: ugo+rw Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 Sep 28 18:38:04 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.393s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f3104d-da10-430b-84a7-ab5ae318d950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[33186647-4625-4ad8-b51d-1802d17c7ef4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56" returned: 0 in 0.267s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:38:04 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info Sep 28 18:38:04 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info" returned: 0 in 0.250s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info is being set with open permissions: ugo+rw Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info Sep 28 18:38:04 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.554s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:38:04 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:04 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.info" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.373s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572381740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b9718b-f026-48b7-b52b-1d69faefe2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:37:56Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Creating volume f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:04 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:04 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 1073741824 Sep 28 18:38:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3722c6ad-37ad-4477-aff4-a3bfad6807bf tempest-CinderUnicodeTest-1519856101 None] Create snapshot completed successfully Sep 28 18:38:04 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-19bfe4af-093f-4b6f-84f1-21c25d238e56-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-19bfe4af-093f-4b6f-84f1-21c25d238e56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:05 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-quobyte-19bfe4af-093f-4b6f-84f1-21c25d238e56" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:05 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c Sep 28 18:38:05 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-19bfe4af-093f-4b6f-84f1-21c25d238e56" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Deleting offline snapshot 19bfe4af-093f-4b6f-84f1-21c25d238e56 of volume 8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] snapshot_file for this snap is: volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38b7ec-97bc-4a18-8b78-0d7aa309b330]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:05 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 Sep 28 18:38:05 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 1073741824" returned: 0 in 0.570s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:05 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950.0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" returned: 0 in 0.307s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c" released by "_delete_snapshot" :: held 1.764s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" released by "delete_snapshot" :: held 1.794s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:05 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 Sep 28 18:38:05 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Created reservations ['cfb8049e-e0e7-44a2-9b2d-3d63dad8035b', '4b3aab11-17c4-4196-8db6-78cea6bc3bdf', '0865f6f8-d110-4250-99ca-7a73aaa30622', 'dde84675-967c-4b0e-8af0-5db9992880d8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Delete snapshot completed successfully. Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1d5f1444-c431-4079-b004-8608e570b1cd tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-0c8e3fdd-6fee-47ed-8c5b-bf4a601cde8c-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:05 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56" returned: 0 in 0.478s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d5876-7611-40b5-936e-a8af37916594]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:05 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.616s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062478881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:01Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume 8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:05 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59121edf-c540-4184-9557-0ed1b94b5826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba7afd7-4f99-45f1-9570-f7862f9063ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:05 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f 1073741824 Sep 28 18:38:05 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-b1f3104d-da10-430b-84a7-ab5ae318d950-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Volume volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 (f1b9718b-f026-48b7-b52b-1d69faefe2d5): created successfully Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba7afd7-4f99-45f1-9570-f7862f9063ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (a5de063b-866c-4c6c-a536-ca0dc61fa370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-82f30183-0cbf-4822-96d5-97c3ba065274 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:38:05 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d Sep 28 18:38:05 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-b1f3104d-da10-430b-84a7-ab5ae318d950-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5110f47-2eb7-446b-ad57-e7a91e7ef062]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:38:06 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:06 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 Sep 28 18:38:06 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:06 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f 1073741824" returned: 0 in 0.635s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:06 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.505s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f Sep 28 18:38:06 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:06 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950 Sep 28 18:38:06 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:06 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56 Sep 28 18:38:06 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:06 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:06 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1648d5d3-3189-4559-9180-d67d9b924de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e042f71-6633-4b4f-aed0-d7da17cc53ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b1f3104d-da10-430b-84a7-ab5ae318d950" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot e3ac2475-3bdc-4b28-afd3-6a669e20ed7c of volume f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[056c4a73-c101-4294-adf9-b72e6e8ac41b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-b1f3104d-da10-430b-84a7-ab5ae318d950" released by "delete_volume" :: held 0.903s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f (8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f): created successfully Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e042f71-6633-4b4f-aed0-d7da17cc53ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (7b98764c-8db1-4190-acee-3b4821ca8d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:06 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d.19bfe4af-093f-4b6f-84f1-21c25d238e56" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8eec4f16-2c71-4cdd-ba00-83fb1f5fd232 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-19bfe4af-093f-4b6f-84f1-21c25d238e56" released by "_delete_snapshot" :: held 1.767s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" released by "delete_snapshot" :: held 1.800s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:07 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 Sep 28 18:38:07 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Created reservations ['a224df7b-3b8a-4a6b-99a8-bfbb2fcf3c1a', '5e4b4803-43d5-4719-be6b-701844b00827', 'a97af30b-5f13-454f-84b7-7613a6e83215', '40981a3e-bd1e-4a22-b4c8-c19bad98ad8f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Created reservations ['b5f600cf-7033-40bb-bb2d-6b09493ca07d', '94ff2e79-d774-4a87-b634-6435128e6c6c', 'd89e63a0-0099-4ca7-80dd-4bee0e59f648', '80cbc9ef-90bc-43bf-a5ab-33c2519ffae2'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:07 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:07 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:07 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Delete snapshot completed successfully. Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-622c4298-b5f0-4423-ab4c-e9a9e89a37a7 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-19bfe4af-093f-4b6f-84f1-21c25d238e56-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:07 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:07 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c 1G Sep 28 18:38:07 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:07 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.274s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-8e410fcb-7f1f-4cbb-98d6-07a99670107d-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:07 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Deleted volume successfully. Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-8e410fcb-7f1f-4cbb-98d6-07a99670107d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4a3c77b3-0e38-4a6c-a7a9-812bfda2c192 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-b1f3104d-da10-430b-84a7-ab5ae318d950-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead21641-fa27-4e39-a3e3-e7b99a814f0f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:07 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d Sep 28 18:38:07 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:07 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c 1G" returned: 0 in 0.503s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:07 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c Sep 28 18:38:07 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (a8bb5719-70e8-49fb-a049-b8102f58cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f54e1d-b4d0-49b0-af29-94d24df2864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f54e1d-b4d0-49b0-af29-94d24df2864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934133161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb53a39b-1db1-4bb9-aa25-6d2c86e0110f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:08Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b952c9e-6c05-4fe0-b8c0-1041f8058fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b952c9e-6c05-4fe0-b8c0-1041f8058fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd0ac35-2e95-4ca7-95a3-7b84385df5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd0ac35-2e95-4ca7-95a3-7b84385df5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb53a39b-1db1-4bb9-aa25-6d2c86e0110f', 'volume_name': 'volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e5f0f-3d86-4668-bd42-5622ebafe072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e5f0f-3d86-4668-bd42-5622ebafe072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed76bb0-08fe-4dc1-b5ca-867c017a2275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume cb53a39b-1db1-4bb9-aa25-6d2c86e0110f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f', 'volume_size': 1} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d" returned: 0 in 0.512s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:08 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:08 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c is being set with open permissions: ugo+rw Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:08 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d Sep 28 18:38:08 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:08 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c Sep 28 18:38:08 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-9a980c08-eabc-4d73-9aa2-ca72320a76b1-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-9a980c08-eabc-4d73-9aa2-ca72320a76b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc986d-3ed0-430a-b2b9-f253fd6f87f5]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:08 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8e410fcb-7f1f-4cbb-98d6-07a99670107d" returned: 0 in 0.353s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-8e410fcb-7f1f-4cbb-98d6-07a99670107d" released by "delete_volume" :: held 0.974s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:08 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 Sep 28 18:38:08 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:08 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (156a2d96-98b8-44b5-a56d-782284ffbd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b650ca44-17eb-415e-bb84-382b77172ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" returned: 0 in 0.507s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b650ca44-17eb-415e-bb84-382b77172ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376582788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7241a24b-e532-4674-a7d6-34762108cc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:09Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c98ed8-4661-43e2-a12d-0f07050332bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c98ed8-4661-43e2-a12d-0f07050332bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c755ea-5a38-4e87-a5ff-711bf6bdfe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c755ea-5a38-4e87-a5ff-711bf6bdfe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7241a24b-e532-4674-a7d6-34762108cc30', 'volume_name': 'volume-7241a24b-e532-4674-a7d6-34762108cc30', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d245d5-735a-484e-9b49-618c5b937454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d245d5-735a-484e-9b49-618c5b937454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c677d1e-e557-40a4-8f23-2160b3383884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:08 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume 7241a24b-e532-4674-a7d6-34762108cc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7241a24b-e532-4674-a7d6-34762108cc30', 'volume_size': 1} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Created reservations ['0da30387-85ba-4ab8-991e-d7774037a9da', '62058036-c11f-46f7-bb12-f38a01a89000', '65f37f47-18bd-49ad-a091-fa0e7e013533', 'f3707e03-b2d9-4c90-80fa-33cab0b9c2c7'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:08 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info Sep 28 18:38:08 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:08 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1" returned: 0 in 0.562s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:09 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1 Sep 28 18:38:09 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:09 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:09 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:09 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:09 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info is being set with open permissions: ugo+rw Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:09 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info Sep 28 18:38:09 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (9e7ce4fd-57e7-424a-8011-2e1d7930d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a39b6f-3da8-4ae3-840d-15f328aefef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a39b6f-3da8-4ae3-840d-15f328aefef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79027250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046a1473-c07b-4330-bc79-58d2efb5de90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:09Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473161a-2721-4d86-a602-9cf3b76ea47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473161a-2721-4d86-a602-9cf3b76ea47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a2b493-4479-4822-91c2-0f2d8e5af16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a2b493-4479-4822-91c2-0f2d8e5af16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046a1473-c07b-4330-bc79-58d2efb5de90', 'volume_name': 'volume-046a1473-c07b-4330-bc79-58d2efb5de90', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a9a80-65fe-41b4-803c-b8bcb23c8d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a9a80-65fe-41b4-803c-b8bcb23c8d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06faba01-6178-4f1f-8976-3fd591597a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume 046a1473-c07b-4330-bc79-58d2efb5de90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046a1473-c07b-4330-bc79-58d2efb5de90', 'volume_size': 1} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9a980c08-eabc-4d73-9aa2-ca72320a76b1" returned: 0 in 0.451s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.367s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-quobyte-9a980c08-eabc-4d73-9aa2-ca72320a76b1" released by "delete_volume" :: held 1.096s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Deleted volume successfully. Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4bd8c0b7-4a61-478a-9658-3d77d2b8fd90 tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-8e410fcb-7f1f-4cbb-98d6-07a99670107d-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Created reservations ['5af9877f-9390-42b4-a5c5-d258b18b41b4', '32070883-461b-4ceb-b473-62b57bf01f0b', '4c7d5c54-192f-4c93-929d-6eadbb7bc6de', 'efdd6ede-4ddd-4003-a9ee-de122fbe7d88'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:09 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.info" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934133161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb53a39b-1db1-4bb9-aa25-6d2c86e0110f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:08Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume cb53a39b-1db1-4bb9-aa25-6d2c86e0110f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:09 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:09 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f 1073741824 Sep 28 18:38:09 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5b82b20e-c862-4fa4-8003-d440325b03e9 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:38:09 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:09 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (f5a1ff04-b9a7-4874-b6f4-344a3558397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cadcef-a2de-4b63-89b4-95fea88a60c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cadcef-a2de-4b63-89b4-95fea88a60c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1117209669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ffc6f3-66d0-4fbd-af8f-f0337c70de80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:10Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b0f13a-4ed4-43fd-ae07-73a1d3256a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b0f13a-4ed4-43fd-ae07-73a1d3256a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d16f77c-b853-4be7-85c4-0d13f864ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d16f77c-b853-4be7-85c4-0d13f864ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ffc6f3-66d0-4fbd-af8f-f0337c70de80', 'volume_name': 'volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec16c0e-010e-48cb-b00e-a6bb8889a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec16c0e-010e-48cb-b00e-a6bb8889a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b5a774-1eba-41aa-a70b-e3a77d6af440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:09 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume 93ffc6f3-66d0-4fbd-af8f-f0337c70de80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80', 'volume_size': 1} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-9547b199-ec61-4f6c-aece-fe2fb3006647-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-9547b199-ec61-4f6c-aece-fe2fb3006647-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "cinder-quobyte-9547b199-ec61-4f6c-aece-fe2fb3006647" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-9547b199-ec61-4f6c-aece-fe2fb3006647" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[77321955-30a3-4da9-b3b0-f5eb77fa01d2]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:10 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot e3ac2475-3bdc-4b28-afd3-6a669e20ed7c of volume f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.508s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27f90d-27fc-47c7-bfa0-43a72f7f161c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Deleted volume successfully. Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 Sep 28 18:38:10 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (4f6704f3-f20a-42a3-8440-91eac440ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82267105-08c4-4c4f-9293-003076299b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f98c33c7-c170-411b-9cc4-ea28adcc4b16 tempest-VolumeDependencyTests-1139773748 None] Lock "cinder-9a980c08-eabc-4d73-9aa2-ca72320a76b1-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82267105-08c4-4c4f-9293-003076299b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855596490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e43a9-06bb-406b-ba04-bb4c80b33460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:10Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce2a078-b614-471d-a1b9-762a4183345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce2a078-b614-471d-a1b9-762a4183345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c Sep 28 18:38:10 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b881bb7-5da4-4ced-acd2-50a680837616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b881bb7-5da4-4ced-acd2-50a680837616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6e43a9-06bb-406b-ba04-bb4c80b33460', 'volume_name': 'volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b1b6e1-8623-442f-85b1-d6009b66e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b1b6e1-8623-442f-85b1-d6009b66e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0097d37e-f211-417d-98d1-1e82e9903473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume 0f6e43a9-06bb-406b-ba04-bb4c80b33460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460', 'volume_size': 1} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f 1073741824" returned: 0 in 0.746s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f Sep 28 18:38:10 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647 Sep 28 18:38:10 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" returned: 0 in 0.455s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:10 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" returned: 0 in 0.313s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.987s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376582788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7241a24b-e532-4674-a7d6-34762108cc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:09Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume 7241a24b-e532-4674-a7d6-34762108cc30 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:10 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3a1fc-9ad3-4a8f-98a3-d52f76c3188f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:10 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 1073741824 Sep 28 18:38:10 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed76bb0-08fe-4dc1-b5ca-867c017a2275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b906b5-0bbc-4bb0-a488-7223a4aec81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:10 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f (cb53a39b-1db1-4bb9-aa25-6d2c86e0110f): created successfully Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b906b5-0bbc-4bb0-a488-7223a4aec81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (a8bb5719-70e8-49fb-a049-b8102f58cc38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9547b199-ec61-4f6c-aece-fe2fb3006647" returned: 0 in 0.351s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:10 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 Sep 28 18:38:10 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-quobyte-9547b199-ec61-4f6c-aece-fe2fb3006647" released by "delete_volume" :: held 0.860s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:10 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f47e8842-d93a-47ce-b88c-58acd6b95a4f tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Created reservations ['35b8f4dd-036b-4441-b9e1-4c3ed67f0bee', 'e16c0c05-e3bd-4fe7-b2f6-9d6503b19e08', '8b05fe01-97dc-4b31-a66c-8ff9b1ddddb4', '558003b9-c7b1-43f9-99d3-702580651f33'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:11 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:11 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:11 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5" returned: 0 in 0.491s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:11 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c Sep 28 18:38:11 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:11 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.393s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Deleted volume successfully. Sep 28 18:38:11 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 1073741824" returned: 0 in 0.741s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f304856f-95d3-494a-9a84-eac9d733677e tempest-CinderUnicodeTest-1519856101 None] Lock "cinder-9547b199-ec61-4f6c-aece-fe2fb3006647-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:11 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 Sep 28 18:38:11 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:11 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" returned: 0 in 0.506s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:11 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c Sep 28 18:38:11 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:11 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30" returned: 0 in 0.354s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79027250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046a1473-c07b-4330-bc79-58d2efb5de90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:09Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume 046a1473-c07b-4330-bc79-58d2efb5de90 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:11 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c677d1e-e557-40a4-8f23-2160b3383884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7241a24b-e532-4674-a7d6-34762108cc30', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dbd9b0-5f32-469f-bed1-5235fa3d7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:11 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 1073741824 Sep 28 18:38:11 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:12 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-7241a24b-e532-4674-a7d6-34762108cc30 (7241a24b-e532-4674-a7d6-34762108cc30): created successfully Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dbd9b0-5f32-469f-bed1-5235fa3d7144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (156a2d96-98b8-44b5-a56d-782284ffbd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-32c5cf7d-d139-44f7-a204-e6918ec1b1e7 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:12 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5.e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c" released by "_delete_snapshot" :: held 1.985s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" released by "delete_snapshot" :: held 2.016s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Created reservations ['f706ef3b-0727-4bb8-9505-d298d992c16d', '1195b4ad-3c0c-4cfa-abeb-4fbc48cbf678', 'b437c636-9ea9-42af-bab2-95c28da55ecb', 'a913b702-6768-469d-8270-df914890cef3'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f3b4cf69-ac33-40dd-8f13-98ddf10726e2 tempest-ProjectMemberTests-277818136 None] Lock "cinder-e3ac2475-3bdc-4b28-afd3-6a669e20ed7c-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:12 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 1073741824" returned: 0 in 0.631s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:12 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 Sep 28 18:38:12 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:12 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1117209669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ffc6f3-66d0-4fbd-af8f-f0337c70de80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:10Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume 93ffc6f3-66d0-4fbd-af8f-f0337c70de80 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:12 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:12 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 1073741824 Sep 28 18:38:12 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06faba01-6178-4f1f-8976-3fd591597a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046a1473-c07b-4330-bc79-58d2efb5de90', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:12 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa893cc7-39c1-44da-8674-7fd0432a79dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:13 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-046a1473-c07b-4330-bc79-58d2efb5de90 (046a1473-c07b-4330-bc79-58d2efb5de90): created successfully Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa893cc7-39c1-44da-8674-7fd0432a79dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (9e7ce4fd-57e7-424a-8011-2e1d7930d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:13 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-2c29ee36-7cbd-4258-bf70-fb0152ae134e tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-f1b9718b-f026-48b7-b52b-1d69faefe2d5-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "cinder-f1b9718b-f026-48b7-b52b-1d69faefe2d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:13 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 1073741824" returned: 0 in 0.598s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2e1c0d-66c6-4b11-be73-fe92876b7e5a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:13 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 Sep 28 18:38:13 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:13 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 Sep 28 18:38:13 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:13 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" returned: 0 in 0.318s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.542s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855596490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e43a9-06bb-406b-ba04-bb4c80b33460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3cc078159049fb89950418f65166d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:10Z,use_quota=True,user_id='0683eaf0fe364f6884e13192e7a11e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Creating volume 0f6e43a9-06bb-406b-ba04-bb4c80b33460 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:13 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:13 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b5a774-1eba-41aa-a70b-e3a77d6af440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:14 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 1073741824 Sep 28 18:38:14 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d273badc-7499-4f40-81d2-61a020c5c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:14 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 (93ffc6f3-66d0-4fbd-af8f-f0337c70de80): created successfully Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d273badc-7499-4f40-81d2-61a020c5c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (f5a1ff04-b9a7-4874-b6f4-344a3558397d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:14 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-85936f30-9158-46f3-97bd-1b7dbba71a43 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:14 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5" returned: 0 in 0.531s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:14 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5 Sep 28 18:38:14 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:14 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f1b9718b-f026-48b7-b52b-1d69faefe2d5" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-f1b9718b-f026-48b7-b52b-1d69faefe2d5" released by "delete_volume" :: held 0.951s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Created reservations ['fbffe452-3651-4c9e-831e-bced0acfb974', '7bff2cf8-b9c0-4257-a3f0-f9b7ad36b6ba', '0229beb1-d877-40de-a521-aeee51bcd335', 'd99a3ff3-9e10-4d4a-bfb7-0e3ae2bd25e8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:14 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 1073741824" returned: 0 in 0.603s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:14 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:14 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:14 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:14 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:14 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460" returned: 0 in 0.310s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0097d37e-f211-417d-98d1-1e82e9903473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9888000-62a9-4f42-879d-432bac1826d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:14 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Volume volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 (0f6e43a9-06bb-406b-ba04-bb4c80b33460): created successfully Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9888000-62a9-4f42-879d-432bac1826d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Flow 'volume_create_manager' (4f6704f3-f20a-42a3-8440-91eac440ad92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:15 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.338s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:15 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-15388362-8826-44a1-bedb-ef0aa7991563 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created volume successfully. Sep 28 18:38:15 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:38:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5046a2f6-dab1-4c46-845c-6c4ad4aaf536 tempest-ProjectMemberTests-277818136 None] Lock "cinder-f1b9718b-f026-48b7-b52b-1d69faefe2d5-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-0f6e43a9-06bb-406b-ba04-bb4c80b33460-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-0f6e43a9-06bb-406b-ba04-bb4c80b33460-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-0f6e43a9-06bb-406b-ba04-bb4c80b33460" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-0f6e43a9-06bb-406b-ba04-bb4c80b33460" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef719b9-737d-41c7-9fb4-e48b45d8bbbd]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:16 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 Sep 28 18:38:16 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (e70f3055-a810-4cca-9ba2-d1b12892abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77157174-e808-4681-85d4-d89127b34ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77157174-e808-4681-85d4-d89127b34ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900010679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff74690-a59b-4ac5-b9d4-371298b650f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:16Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b161129b-1f04-4071-8a87-99b4695d3212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b161129b-1f04-4071-8a87-99b4695d3212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe9c81-fc6c-4240-a6ff-efe728ce9487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe9c81-fc6c-4240-a6ff-efe728ce9487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff74690-a59b-4ac5-b9d4-371298b650f3', 'volume_name': 'volume-7ff74690-a59b-4ac5-b9d4-371298b650f3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd1c9d4-b6fe-47f3-83b1-a29810622270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd1c9d4-b6fe-47f3-83b1-a29810622270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e661cb-046c-49fe-b6d4-8d23ea7e40a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:16 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Volume 7ff74690-a59b-4ac5-b9d4-371298b650f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff74690-a59b-4ac5-b9d4-371298b650f3', 'volume_size': 1} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900010679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff74690-a59b-4ac5-b9d4-371298b650f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:16Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Creating volume 7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:16 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:16 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 1073741824 Sep 28 18:38:16 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:16 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:16 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460 Sep 28 18:38:16 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:17 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 1073741824" returned: 0 in 0.563s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:17 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0f6e43a9-06bb-406b-ba04-bb4c80b33460" returned: 0 in 0.386s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-0f6e43a9-06bb-406b-ba04-bb4c80b33460" released by "delete_volume" :: held 0.887s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:17 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 Sep 28 18:38:17 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['4c673ac7-6220-48cd-b8a8-05720187be27', '86ca8c60-242c-40a9-b6ea-6bdc4c87f4c3', 'cce7b278-5e02-40fa-9868-81e3dfdae6e9', '4d8a6f7d-538a-426c-8242-4befcb6f24e4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:17 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:17 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-93ffc6f3-66d0-4fbd-af8f-f0337c70de80-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-93ffc6f3-66d0-4fbd-af8f-f0337c70de80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:17 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3" returned: 0 in 0.447s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a705b48-95fc-4a28-93a5-3cf00f22a4b8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e661cb-046c-49fe-b6d4-8d23ea7e40a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff74690-a59b-4ac5-b9d4-371298b650f3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d669b57f-d3c0-4d22-9e4c-a4b210f03902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:17 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Volume volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 (7ff74690-a59b-4ac5-b9d4-371298b650f3): created successfully Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d669b57f-d3c0-4d22-9e4c-a4b210f03902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (e70f3055-a810-4cca-9ba2-d1b12892abd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e97cae4f-59f6-4991-929c-20bc9c740068 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:38:17 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.395s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:17 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 Sep 28 18:38:17 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-4f7ddc49-803c-4e28-b319-ab9e419603b8 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-0f6e43a9-06bb-406b-ba04-bb4c80b33460-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:18 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" returned: 0 in 0.539s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:18 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80 Sep 28 18:38:18 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:18 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-93ffc6f3-66d0-4fbd-af8f-f0337c70de80" released by "delete_volume" :: held 0.907s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['5f8885ee-aa1d-499e-b25c-e823c34359ba', '4e9b42ca-b304-419d-a76b-de59ce1087d2', '42c565e9-f651-4340-8012-01165bdf5830', '24d6d031-1777-44bf-a5fc-ad163d18ecb4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 164d467f-71ba-4f74-9909-c52caac3eecd of volume 7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bc39b-7774-42d8-a756-a064a7e00bfb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:18 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:18 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:18 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 Sep 28 18:38:18 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:18 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.298s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:18 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-18e6841f-0f99-4f8a-bbe6-22518ed33489 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-93ffc6f3-66d0-4fbd-af8f-f0337c70de80-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:19 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3" returned: 0 in 0.458s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:19 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd 1G Sep 28 18:38:19 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:19 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd 1G" returned: 0 in 0.526s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:19 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd Sep 28 18:38:19 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-046a1473-c07b-4330-bc79-58d2efb5de90-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-046a1473-c07b-4330-bc79-58d2efb5de90-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-046a1473-c07b-4330-bc79-58d2efb5de90" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-046a1473-c07b-4330-bc79-58d2efb5de90" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58607d-df62-4602-9351-ebdd0bd2f109]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:19 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 Sep 28 18:38:19 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd" returned: 0 in 0.458s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:20 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd is being set with open permissions: ugo+rw Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:20 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd Sep 28 18:38:20 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90" returned: 0 in 0.445s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:20 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90 Sep 28 18:38:20 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd" returned: 0 in 0.303s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:20 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info Sep 28 18:38:20 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-046a1473-c07b-4330-bc79-58d2efb5de90" returned: 0 in 0.264s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-046a1473-c07b-4330-bc79-58d2efb5de90" released by "delete_volume" :: held 0.773s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:20 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['cc8afcff-4608-418b-8fb9-87f8ef5ae8c9', 'f6f00a1a-e256-4810-be09-c06767828c76', 'cbd6872d-6998-4c85-a840-151d71f8605d', '9cbf7228-cdfb-41b7-b144-ee0921204098'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info" returned: 0 in 0.283s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:20 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info is being set with open permissions: ugo+rw Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:20 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info Sep 28 18:38:20 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:20 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:20 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-7241a24b-e532-4674-a7d6-34762108cc30-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-7241a24b-e532-4674-a7d6-34762108cc30-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-7241a24b-e532-4674-a7d6-34762108cc30" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:20 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-7241a24b-e532-4674-a7d6-34762108cc30" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.info" returned: 0 in 0.383s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd1dfa-22a9-44f1-808a-9ad2e7fb4d9f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:21 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.319s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:21 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-607fbba6-0151-408f-8962-881816dadec1 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-da1b4e86-1d7c-4020-b573-d48f553c46d2 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-046a1473-c07b-4330-bc79-58d2efb5de90-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:21 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 Sep 28 18:38:21 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:21 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30" returned: 0 in 0.437s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:21 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30 Sep 28 18:38:21 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-164d467f-71ba-4f74-9909-c52caac3eecd-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-164d467f-71ba-4f74-9909-c52caac3eecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-164d467f-71ba-4f74-9909-c52caac3eecd" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-164d467f-71ba-4f74-9909-c52caac3eecd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 164d467f-71ba-4f74-9909-c52caac3eecd of volume 7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:21 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7241a24b-e532-4674-a7d6-34762108cc30" returned: 0 in 0.339s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-7241a24b-e532-4674-a7d6-34762108cc30" released by "delete_volume" :: held 0.845s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1284e0b5-b4e4-49d4-ae6d-5b848449e23d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:21 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['5b26892d-7515-483d-9833-9d571e2137b7', '8961951f-632d-4f6a-a225-72ce2113da0f', 'b06430dd-c262-4469-a465-d52448cdda29', '78b763e6-f519-4fea-810b-57ed050ecea4'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:21 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd Sep 28 18:38:21 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:22 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:22 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8bffaa-e11d-4bb0-a1e2-7f9790425dbc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:22 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd" returned: 0 in 0.589s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff74690-a59b-4ac5-b9d4-371298b650f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:22 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f Sep 28 18:38:22 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:22 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[885049de-1611-4b24-8fa7-baa60fa5dfd3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-b385d260-378a-4275-b29d-fbbba37292e6 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-7241a24b-e532-4674-a7d6-34762108cc30-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:22 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 Sep 28 18:38:22 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:22 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" returned: 0 in 0.601s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:22 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f Sep 28 18:38:22 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:23 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3" returned: 0 in 0.585s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:23 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd Sep 28 18:38:23 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:23 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" returned: 0 in 0.362s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f" released by "delete_volume" :: held 1.052s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['708913fb-2397-48d3-944d-830b4606790c', '301586ec-db85-4e3f-b1f3-d1ad706a4543', '65075c4a-0190-4c1b-aa24-0627ba289b18', '36eda86d-31e2-4bb3-a7b4-ab473c280987'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:23 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:23 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:23 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd" returned: 0 in 0.489s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:23 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd Sep 28 18:38:23 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:23 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.323s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:23 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1317afc3-8dc3-484c-955d-0d899fa781a9 tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-cb53a39b-1db1-4bb9-aa25-6d2c86e0110f-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:23 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3.164d467f-71ba-4f74-9909-c52caac3eecd" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-164d467f-71ba-4f74-9909-c52caac3eecd" released by "_delete_snapshot" :: held 2.199s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" released by "delete_snapshot" :: held 2.228s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Created reservations ['ea812804-8556-4f1a-8010-30ab1562aff8', '47801352-93a5-415a-968d-2cb4cf8ce931', 'b53ff6de-f852-418f-a59a-8dd972d87fb1', '12916139-fe86-4356-8654-53539537541a'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ba6fc0ad-b434-48be-8b0d-95a022300a09 tempest-ProjectMemberTests-277818136 None] Lock "cinder-164d467f-71ba-4f74-9909-c52caac3eecd-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "cinder-quobyte-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5481205-a727-40b4-bd1f-a5bab2be30fb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:24 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f Sep 28 18:38:24 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-7ff74690-a59b-4ac5-b9d4-371298b650f3-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:25 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" returned: 0 in 0.518s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "cinder-7ff74690-a59b-4ac5-b9d4-371298b650f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:25 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f Sep 28 18:38:25 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876e299-74a8-47a3-9323-39b8b1ce97a6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:25 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 Sep 28 18:38:25 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:25 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" returned: 0 in 0.326s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-quobyte-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f" released by "delete_volume" :: held 0.910s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Created reservations ['6d2d55ed-d635-4732-a03c-2bd9c6a26a33', '0367f213-0d03-4193-9190-d501d010421c', '3a376a96-fc0e-45e1-86d7-a525933390fc', 'c942cf74-aa74-4a67-999f-ce3890207c0c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:25 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:25 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:25 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3" returned: 0 in 0.461s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:25 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3 Sep 28 18:38:25 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:25 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Deleted volume successfully. Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ceb8ae2-9787-4879-a2e7-2528d40f4bbc tempest-CreateVolumesFromSourceVolumeTest-905282890 None] Lock "cinder-8f5b94f3-5bfb-4ac5-80d3-ee7aa615cd7f-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:26 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7ff74690-a59b-4ac5-b9d4-371298b650f3" returned: 0 in 0.413s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-7ff74690-a59b-4ac5-b9d4-371298b650f3" released by "delete_volume" :: held 1.003s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=232,cinder:UPDATE=315,cinder:DELETE=29,cinder:INSERT=82 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Created reservations ['29c19f14-6a62-4085-be32-64b3338e2c45', '08b0230b-6a2f-4c94-a1b2-6b15f693bf4d', 'e2a61c1a-3d42-4536-abbc-f86620dd5a1f', '25bb71ed-5f93-4565-ac98-833b4533a524'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:26 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:26 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:26 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.345s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=232,cinder:UPDATE=303,cinder:INSERT=87,cinder:DELETE=26 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:38:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a9045717-e098-46bc-8fdc-390fcf08ba82 tempest-ProjectMemberTests-277818136 None] Lock "cinder-7ff74690-a59b-4ac5-b9d4-371298b650f3-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Flow 'volume_create_manager' (2b72e9a3-c6d5-49de-993a-38752e11ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e726fc7-d179-4152-bb85-bbc715167b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e726fc7-d179-4152-bb85-bbc715167b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582379695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d5269c-bcde-4bf5-9ded-c827f595cb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9042efa5749e88327dcacaba7fb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:28Z,use_quota=True,user_id='101fe4c1b5304893821a43e7c2545dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03f41c2-e361-4de8-b2e7-9a7fba28293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03f41c2-e361-4de8-b2e7-9a7fba28293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd58d802-c8d1-45f1-af9e-13d1f710e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd58d802-c8d1-45f1-af9e-13d1f710e03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d5269c-bcde-4bf5-9ded-c827f595cb05', 'volume_name': 'volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712786dd-f4db-4403-88c6-b55e6257f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712786dd-f4db-4403-88c6-b55e6257f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a546aa74-b54f-44df-a78e-4341e65f678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:27 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Volume f0d5269c-bcde-4bf5-9ded-c827f595cb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05', 'volume_size': 1} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582379695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d5269c-bcde-4bf5-9ded-c827f595cb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9042efa5749e88327dcacaba7fb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:28Z,use_quota=True,user_id='101fe4c1b5304893821a43e7c2545dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Creating volume f0d5269c-bcde-4bf5-9ded-c827f595cb05 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:27 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:27 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 1073741824 Sep 28 18:38:27 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (075a8d0d-a7c3-4556-a44b-3d4cbff705b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:27 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731a5c8e-4d22-4090-b574-fd3ba47a1738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731a5c8e-4d22-4090-b574-fd3ba47a1738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90675852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ca3e9e-879e-48c1-9470-ef7abd664ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:28Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd6d39-8314-4581-88c5-5f76b173dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd6d39-8314-4581-88c5-5f76b173dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975af0ea-21d5-471d-9337-d53f290fea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975af0ea-21d5-471d-9337-d53f290fea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ca3e9e-879e-48c1-9470-ef7abd664ad5', 'volume_name': 'volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0735a058-68eb-48df-a1ed-8a34f77ac9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0735a058-68eb-48df-a1ed-8a34f77ac9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25890579-12ec-49c8-ab81-648ff6c416f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Volume 48ca3e9e-879e-48c1-9470-ef7abd664ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5', 'volume_size': 1} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:28 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 1073741824" returned: 0 in 0.546s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:28 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 Sep 28 18:38:28 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:28 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90675852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ca3e9e-879e-48c1-9470-ef7abd664ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:28Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Creating volume 48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:28 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:28 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 1073741824 Sep 28 18:38:28 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a546aa74-b54f-44df-a78e-4341e65f678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99d2bf5-a1e2-4e0a-9866-c8c545e71897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:28 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Volume volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 (f0d5269c-bcde-4bf5-9ded-c827f595cb05): created successfully Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99d2bf5-a1e2-4e0a-9866-c8c545e71897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:28 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Flow 'volume_create_manager' (2b72e9a3-c6d5-49de-993a-38752e11ed27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:28 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d8e9e932-069c-49eb-a561-020659d2366e tempest-ProjectReaderTests-944213210 None] Created volume successfully. Sep 28 18:38:29 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 1073741824" returned: 0 in 0.530s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:29 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 Sep 28 18:38:29 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:29 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25890579-12ec-49c8-ab81-648ff6c416f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d348b276-4e68-4b17-b2ed-0bce6bb817e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:29 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Volume volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 (48ca3e9e-879e-48c1-9470-ef7abd664ad5): created successfully Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d348b276-4e68-4b17-b2ed-0bce6bb817e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (075a8d0d-a7c3-4556-a44b-3d4cbff705b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:29 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ecfcc5cf-9693-4670-8a02-2b9dd9fae14c tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Acquiring lock "cinder-f0d5269c-bcde-4bf5-9ded-c827f595cb05-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "cinder-f0d5269c-bcde-4bf5-9ded-c827f595cb05-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Acquiring lock "cinder-quobyte-f0d5269c-bcde-4bf5-9ded-c827f595cb05" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "cinder-quobyte-f0d5269c-bcde-4bf5-9ded-c827f595cb05" acquired by "delete_volume" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb6f3f-ad2f-43a9-9b7a-884408846b3b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:30 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 Sep 28 18:38:30 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (e894ffa3-e1e9-48a3-9932-5a093eb1ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfc82e1-d0c0-47bd-80f3-e2fb84df36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfc82e1-d0c0-47bd-80f3-e2fb84df36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599165255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030f9bf7-5a88-4801-8aff-716976a8183f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:30Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f3640-5000-4a6c-9ccb-b37d8acae9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f3640-5000-4a6c-9ccb-b37d8acae9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e461b-30f3-4dfa-89bc-8b89daa14523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e461b-30f3-4dfa-89bc-8b89daa14523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030f9bf7-5a88-4801-8aff-716976a8183f', 'volume_name': 'volume-030f9bf7-5a88-4801-8aff-716976a8183f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c94713-247f-47bf-a751-fc6eda822bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c94713-247f-47bf-a751-fc6eda822bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526bd40a-603d-4383-b306-bc1e2b92215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:30 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Volume 030f9bf7-5a88-4801-8aff-716976a8183f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030f9bf7-5a88-4801-8aff-716976a8183f', 'volume_size': 1} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599165255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030f9bf7-5a88-4801-8aff-716976a8183f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:30Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Creating volume 030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:30 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:30 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f 1073741824 Sep 28 18:38:30 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:30 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05" returned: 0 in 0.514s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:30 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05 Sep 28 18:38:30 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:30 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:30 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f 1073741824" returned: 0 in 0.521s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-f0d5269c-bcde-4bf5-9ded-c827f595cb05" returned: 0 in 0.352s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "cinder-quobyte-f0d5269c-bcde-4bf5-9ded-c827f595cb05" released by "delete_volume" :: held 0.937s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:31 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f Sep 28 18:38:31 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Created reservations ['9366b6c4-4a12-4aa1-8b3b-8f1c0e899cfd', '6120a92d-f9e3-4bc8-9944-d510e19d538d', 'd096bf8e-c089-4e85-8e6e-94a0158caa4a', '6be7b1f8-9c3a-405e-89ac-e2b46b7daab6'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:31 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:31 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:31 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f" returned: 0 in 0.344s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.896s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526bd40a-603d-4383-b306-bc1e2b92215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030f9bf7-5a88-4801-8aff-716976a8183f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242d045c-8f63-4afd-82a9-163f6a22b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.263s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 0500b9ac-4f81-483c-9bdf-a5a18e1009ab of volume 48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Deleted volume successfully. Sep 28 18:38:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Volume volume-030f9bf7-5a88-4801-8aff-716976a8183f (030f9bf7-5a88-4801-8aff-716976a8183f): created successfully Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242d045c-8f63-4afd-82a9-163f6a22b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (e894ffa3-e1e9-48a3-9932-5a093eb1ce54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[715e5d2c-821a-42a4-8d07-612487a35d16]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:31 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-732debb2-8467-4087-8e83-32987cab95b2 tempest-ProjectReaderTests-1362777320 None] Created volume successfully. Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-515e8b41-97d6-4d5e-accb-131b54684a65 tempest-ProjectReaderTests-944213210 None] Lock "cinder-f0d5269c-bcde-4bf5-9ded-c827f595cb05-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:31 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 Sep 28 18:38:31 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Flow 'volume_create_manager' (fd7dd26e-7b0c-4e4f-b2b8-aea3a0d6ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7229199e-1049-4350-bb12-b9782baf703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7229199e-1049-4350-bb12-b9782baf703e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867066352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb5dc33-669f-408a-944d-0846a53d4916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9042efa5749e88327dcacaba7fb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:32Z,use_quota=True,user_id='101fe4c1b5304893821a43e7c2545dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a8aaaf-5cf9-431f-bfcd-e2bf390cc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a8aaaf-5cf9-431f-bfcd-e2bf390cc9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e709ba-493c-46a2-bb80-d7fe895f2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e709ba-493c-46a2-bb80-d7fe895f2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb5dc33-669f-408a-944d-0846a53d4916', 'volume_name': 'volume-9bb5dc33-669f-408a-944d-0846a53d4916', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4299dc00-7c07-448d-8de6-c1da94aca629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4299dc00-7c07-448d-8de6-c1da94aca629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868e7c5e-94d1-474a-9547-70eb37d15726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:31 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Volume 9bb5dc33-669f-408a-944d-0846a53d4916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb5dc33-669f-408a-944d-0846a53d4916', 'volume_size': 1} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:31 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5" returned: 0 in 0.499s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:31 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab 1G Sep 28 18:38:31 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:32 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab 1G" returned: 0 in 0.492s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:32 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab Sep 28 18:38:32 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:32 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab" returned: 0 in 0.368s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:32 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab is being set with open permissions: ugo+rw Sep 28 18:38:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:32 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab Sep 28 18:38:32 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:33 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:33 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info Sep 28 18:38:33 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:33 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:33 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info is being set with open permissions: ugo+rw Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:33 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info Sep 28 18:38:33 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:33 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.info" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867066352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb5dc33-669f-408a-944d-0846a53d4916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9042efa5749e88327dcacaba7fb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:32Z,use_quota=True,user_id='101fe4c1b5304893821a43e7c2545dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Creating volume 9bb5dc33-669f-408a-944d-0846a53d4916 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:33 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:33 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 1073741824 Sep 28 18:38:33 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3b2e7af9-1f74-4fea-92b7-1bb1cef114c6 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:38:34 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 1073741824" returned: 0 in 0.525s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:34 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 Sep 28 18:38:34 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-0500b9ac-4f81-483c-9bdf-a5a18e1009ab-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-0500b9ac-4f81-483c-9bdf-a5a18e1009ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-0500b9ac-4f81-483c-9bdf-a5a18e1009ab" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0500b9ac-4f81-483c-9bdf-a5a18e1009ab" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 0500b9ac-4f81-483c-9bdf-a5a18e1009ab of volume 48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:34 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916" returned: 0 in 0.322s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.081s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1294c326-7bb9-4abe-a8ea-e58ce9cbf723]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Creating offline snapshot d6034f6a-6099-4733-aa41-67d9b5dfa28b of volume 030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868e7c5e-94d1-474a-9547-70eb37d15726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb5dc33-669f-408a-944d-0846a53d4916', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dde5c6-89a8-458c-ad01-6a0bfb603677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35f5ce1-8733-4fbc-bdd1-9fbf98389637]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:34 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Volume volume-9bb5dc33-669f-408a-944d-0846a53d4916 (9bb5dc33-669f-408a-944d-0846a53d4916): created successfully Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dde5c6-89a8-458c-ad01-6a0bfb603677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:34 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Flow 'volume_create_manager' (fd7dd26e-7b0c-4e4f-b2b8-aea3a0d6ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:34 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-125c4ae7-dbcb-43e7-8421-10c909dd552e tempest-ProjectReaderTests-944213210 None] Created volume successfully. Sep 28 18:38:34 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab Sep 28 18:38:34 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:34 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f Sep 28 18:38:34 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Acquiring lock "cinder-9bb5dc33-669f-408a-944d-0846a53d4916-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "cinder-9bb5dc33-669f-408a-944d-0846a53d4916-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Acquiring lock "cinder-quobyte-9bb5dc33-669f-408a-944d-0846a53d4916" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "cinder-quobyte-9bb5dc33-669f-408a-944d-0846a53d4916" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3989c5a-37d1-4c4d-ad15-a9aa6b0f6462]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab" returned: 0 in 0.600s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:35 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f" returned: 0 in 0.581s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb831c-de2b-4534-b4ce-311c41297502]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b 1G Sep 28 18:38:35 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 Sep 28 18:38:35 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 Sep 28 18:38:35 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916" returned: 0 in 0.462s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916 Sep 28 18:38:35 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5" returned: 0 in 0.456s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab Sep 28 18:38:35 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:35 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b 1G" returned: 0 in 0.586s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030f9bf7-5a88-4801-8aff-716976a8183f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:35 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030f9bf7-5a88-4801-8aff-716976a8183f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b Sep 28 18:38:35 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:36 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-9bb5dc33-669f-408a-944d-0846a53d4916" returned: 0 in 0.332s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "cinder-quobyte-9bb5dc33-669f-408a-944d-0846a53d4916" released by "delete_volume" :: held 0.860s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Created reservations ['7a9677b8-46ec-4802-9c1f-2d512aba32f1', 'c2bfcd3c-6149-40c2-a3b1-774405aaff02', 'd5fb0100-37f5-400f-9b75-c80c020de374', '10465569-0dcf-4c46-a9a4-8dbd1d71168c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:36 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:36 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab Sep 28 18:38:36 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:36 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030f9bf7-5a88-4801-8aff-716976a8183f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b" returned: 0 in 0.401s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:36 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b is being set with open permissions: ugo+rw Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:36 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:36 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b Sep 28 18:38:36 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:36 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5.0500b9ac-4f81-483c-9bdf-a5a18e1009ab" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0500b9ac-4f81-483c-9bdf-a5a18e1009ab" released by "_delete_snapshot" :: held 1.961s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" released by "delete_snapshot" :: held 2.006s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Created reservations ['b8181ef9-d89e-4a21-8ad5-c529f82f476e', 'c4419dcd-4862-4c76-935a-f3de5ac56de0', 'cda602d5-2bd9-4b56-840b-90c1774c0b4f', '8301cfaf-67c4-4830-9b3f-29572631a029'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:36 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:36 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Deleted volume successfully. Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b" returned: 0 in 0.470s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9bf425f4-1fcd-46e7-8ed7-bfed58ace2f3 tempest-ProjectReaderTests-944213210 None] Lock "cinder-9bb5dc33-669f-408a-944d-0846a53d4916-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:38:36 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-275d599a-b589-4066-9b58-1c513843ccef tempest-ProjectMemberTests-277818136 None] Lock "cinder-0500b9ac-4f81-483c-9bdf-a5a18e1009ab-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:36 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info Sep 28 18:38:36 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:37 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info" returned: 0 in 0.295s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:37 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info is being set with open permissions: ugo+rw Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:37 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info Sep 28 18:38:37 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:37 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.info" returned: 0 in 0.260s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:37 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9378d906-9860-4e74-a5f4-c2ff8cee3b8f tempest-ProjectReaderTests-1362777320 None] Create snapshot completed successfully Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-48ca3e9e-879e-48c1-9470-ef7abd664ad5-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "cinder-48ca3e9e-879e-48c1-9470-ef7abd664ad5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:37 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae44ec-af36-48a2-a98d-d54dbc81f365]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:38 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 Sep 28 18:38:38 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-d6034f6a-6099-4733-aa41-67d9b5dfa28b-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-d6034f6a-6099-4733-aa41-67d9b5dfa28b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-d6034f6a-6099-4733-aa41-67d9b5dfa28b" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-d6034f6a-6099-4733-aa41-67d9b5dfa28b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Deleting offline snapshot d6034f6a-6099-4733-aa41-67d9b5dfa28b of volume 030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] snapshot_file for this snap is: volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f7f1a0-44ce-4c34-a5db-11e3707b8e0b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:38 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b Sep 28 18:38:38 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:38 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5" returned: 0 in 0.553s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:38 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5 Sep 28 18:38:38 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:38 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-48ca3e9e-879e-48c1-9470-ef7abd664ad5" returned: 0 in 0.317s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-48ca3e9e-879e-48c1-9470-ef7abd664ad5" released by "delete_volume" :: held 0.977s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:38 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b" returned: 0 in 0.526s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:38 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030f9bf7-5a88-4801-8aff-716976a8183f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640ccee-dda4-4899-8bec-f495c0cc5586]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Created reservations ['a1e2be3a-a54e-4241-ab21-8a9777635a09', '478a0a74-aa2d-4a5b-a223-842082c99256', '892c21a2-0754-4485-baf4-b98870bbedb7', 'd1b307b7-e6a8-45a8-895f-5ca9450b53fc'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:39 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f Sep 28 18:38:39 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:39 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:39 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:39 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f" returned: 0 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:39 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.291s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:38:39 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b Sep 28 18:38:39 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c9b97928-cdd8-4f7d-9f4d-9b9ddff5ddac tempest-ProjectMemberTests-277818136 None] Lock "cinder-48ca3e9e-879e-48c1-9470-ef7abd664ad5-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:39 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b" returned: 0 in 0.470s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:39 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b Sep 28 18:38:39 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:40 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f.d6034f6a-6099-4733-aa41-67d9b5dfa28b" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-d6034f6a-6099-4733-aa41-67d9b5dfa28b" released by "_delete_snapshot" :: held 1.852s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" released by "delete_snapshot" :: held 1.886s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Created reservations ['34cfa5b1-f003-47c0-8e81-b2827f591912', '1a665b2c-f1b6-4261-ac83-b18b4a2ad452', 'a9e65fcf-d773-4f33-b95d-5e9d1bdf9cdb', 'd476d478-8d0a-4b8b-8268-8d0c8c926ce1'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:40 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Delete snapshot completed successfully. Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5b079440-0961-4b29-862c-428504c5bbd1 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-d6034f6a-6099-4733-aa41-67d9b5dfa28b-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-030f9bf7-5a88-4801-8aff-716976a8183f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "cinder-030f9bf7-5a88-4801-8aff-716976a8183f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ad514-df07-4fc6-8b15-9f86d8b49fa0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (2eced6b7-3bc5-478f-8465-ee779eb11577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2beec73-6a49-4be3-b81a-9cf24d2c1757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2beec73-6a49-4be3-b81a-9cf24d2c1757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430038450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650b2f4d-ca8b-4a07-9148-fa5cb2c65919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:41Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47fa343-3a82-4668-a33b-c9222f611188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47fa343-3a82-4668-a33b-c9222f611188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfda132-bc01-47ef-a821-65113b1aa4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfda132-bc01-47ef-a821-65113b1aa4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650b2f4d-ca8b-4a07-9148-fa5cb2c65919', 'volume_name': 'volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:40 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f Sep 28 18:38:40 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8603e67-5193-41ed-b2e6-0876a19feb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8603e67-5193-41ed-b2e6-0876a19feb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2836380-d14a-45e9-a758-dc26e0e74f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:40 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Volume 650b2f4d-ca8b-4a07-9148-fa5cb2c65919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919', 'volume_size': 1} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430038450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650b2f4d-ca8b-4a07-9148-fa5cb2c65919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:41Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Creating volume 650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:40 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:40 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 1073741824 Sep 28 18:38:40 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:41 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:41 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f Sep 28 18:38:41 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:41 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 1073741824" returned: 0 in 0.529s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:41 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-030f9bf7-5a88-4801-8aff-716976a8183f" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-030f9bf7-5a88-4801-8aff-716976a8183f" released by "delete_volume" :: held 0.806s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:41 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 Sep 28 18:38:41 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Created reservations ['53add6d7-54d6-4cdf-8d82-3694de48342b', 'd7806a24-65e6-451b-89b1-cca69ec5afa7', '577b702d-5adb-44c9-8ffd-4d3f4b549c60', 'ed468c63-7c63-474e-853e-dee9479badaa'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:41 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:41 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:41 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" returned: 0 in 0.329s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2836380-d14a-45e9-a758-dc26e0e74f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68977ed0-d33f-49ad-ba91-59b9ef28a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:41 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Volume volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 (650b2f4d-ca8b-4a07-9148-fa5cb2c65919): created successfully Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68977ed0-d33f-49ad-ba91-59b9ef28a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (2eced6b7-3bc5-478f-8465-ee779eb11577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a02f1e1f-d383-4d6f-84d3-1424b7374672 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:38:41 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.327s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:41 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Deleted volume successfully. Sep 28 18:38:41 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-47239c79-1498-4224-b8b5-69c9547d3c2a tempest-ProjectReaderTests-1362777320 None] Lock "cinder-030f9bf7-5a88-4801-8aff-716976a8183f-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (a47151b9-b5b6-42a7-bbc7-073448788947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe603275-53dc-4f2b-a1c3-5b4775e62937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe603275-53dc-4f2b-a1c3-5b4775e62937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246790193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0838d5f-627a-4095-ac69-30596a6b0aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:42Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0e3ed8-7f5d-4ee0-b6b5-285654606387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0e3ed8-7f5d-4ee0-b6b5-285654606387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ad516-cef8-45e8-88d2-92cc53730ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ad516-cef8-45e8-88d2-92cc53730ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0838d5f-627a-4095-ac69-30596a6b0aaa', 'volume_name': 'volume-b0838d5f-627a-4095-ac69-30596a6b0aaa', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f6397-c964-49d4-8098-596193ebbd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f6397-c964-49d4-8098-596193ebbd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68631b4-171d-4b53-8f09-c91209c2b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:42 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Volume b0838d5f-627a-4095-ac69-30596a6b0aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0838d5f-627a-4095-ac69-30596a6b0aaa', 'volume_size': 1} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246790193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0838d5f-627a-4095-ac69-30596a6b0aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:42Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Creating volume b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:42 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:42 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa 1073741824 Sep 28 18:38:42 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:42 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa 1073741824" returned: 0 in 0.538s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:43 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa Sep 28 18:38:43 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:43 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.196s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68631b4-171d-4b53-8f09-c91209c2b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0838d5f-627a-4095-ac69-30596a6b0aaa', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654466c-e2e6-401f-a72c-7a42bd08ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 0ecae265-f002-47a5-83f5-f757a87077e2 of volume 650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:43 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Volume volume-b0838d5f-627a-4095-ac69-30596a6b0aaa (b0838d5f-627a-4095-ac69-30596a6b0aaa): created successfully Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654466c-e2e6-401f-a72c-7a42bd08ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (a47151b9-b5b6-42a7-bbc7-073448788947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0bca25-f11e-4b05-84e2-96d31addc0b8]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5850f7dd-f935-48a3-b242-fc378f00ccb0 tempest-ProjectReaderTests-1362777320 None] Created volume successfully. Sep 28 18:38:43 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 Sep 28 18:38:43 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:43 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" returned: 0 in 0.407s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:43 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 1G Sep 28 18:38:43 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:44 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 1G" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:44 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 Sep 28 18:38:44 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:44 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2" returned: 0 in 0.321s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:44 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 is being set with open permissions: ugo+rw Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:44 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 Sep 28 18:38:44 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:44 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:44 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:44 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info Sep 28 18:38:44 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:45 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:45 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info is being set with open permissions: ugo+rw Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:45 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info Sep 28 18:38:45 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:45 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.info" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.795s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Creating offline snapshot 9173bb31-b21e-4805-95f9-708508353044 of volume b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:45 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-61750e27-eef9-482c-a474-2942380bf3de tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac19845-b3a8-4c17-96b8-36ac8bf78c04]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:45 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa Sep 28 18:38:45 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:45 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:45 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:45 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 1G Sep 28 18:38:45 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-0ecae265-f002-47a5-83f5-f757a87077e2-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-0ecae265-f002-47a5-83f5-f757a87077e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-0ecae265-f002-47a5-83f5-f757a87077e2" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0ecae265-f002-47a5-83f5-f757a87077e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 0ecae265-f002-47a5-83f5-f757a87077e2 of volume 650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2686a2-ff0d-4441-b953-5560bdc45426]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:46 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 1G" returned: 0 in 0.597s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0838d5f-627a-4095-ac69-30596a6b0aaa -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:46 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0838d5f-627a-4095-ac69-30596a6b0aaa -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 Sep 28 18:38:46 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:46 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 Sep 28 18:38:46 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:46 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0838d5f-627a-4095-ac69-30596a6b0aaa -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:46 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 is being set with open permissions: ugo+rw Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:46 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 Sep 28 18:38:46 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:46 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2" returned: 0 in 0.491s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f612083c-2a74-4450-9f29-ee9e1b87f1de]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:47 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 Sep 28 18:38:47 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:47 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044" returned: 0 in 0.267s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:47 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info Sep 28 18:38:47 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:47 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" returned: 0 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:47 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 Sep 28 18:38:47 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:47 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:47 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info is being set with open permissions: ugo+rw Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:47 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info Sep 28 18:38:47 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:47 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.info" returned: 0 in 0.273s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:47 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-e1297a25-49bc-4df1-bba7-fe58f3b54e32 tempest-ProjectReaderTests-1362777320 None] Create snapshot completed successfully Sep 28 18:38:47 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2" returned: 0 in 0.441s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:47 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:47 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2 Sep 28 18:38:47 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:48 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919.0ecae265-f002-47a5-83f5-f757a87077e2" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0ecae265-f002-47a5-83f5-f757a87077e2" released by "_delete_snapshot" :: held 1.743s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" released by "delete_snapshot" :: held 1.772s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Created reservations ['48a8baac-9737-4e65-84f6-bd66747b8e85', '0babe9c8-b4b9-47d2-bd7c-a64057ccf8ac', '18bca6f8-2d87-4b9d-8829-4bde44da76d4', '9da53b1b-eea0-4c63-bd9a-8d3c62a4f749'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ce1a5f42-af7a-485d-b584-12ec8c89d2e3 tempest-ProjectMemberTests-277818136 None] Lock "cinder-0ecae265-f002-47a5-83f5-f757a87077e2-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-650b2f4d-ca8b-4a07-9148-fa5cb2c65919-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "cinder-650b2f4d-ca8b-4a07-9148-fa5cb2c65919-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea7f8b8-78b7-44a3-b126-d1e2a9097ac6]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:48 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 Sep 28 18:38:48 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-9173bb31-b21e-4805-95f9-708508353044-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-9173bb31-b21e-4805-95f9-708508353044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-9173bb31-b21e-4805-95f9-708508353044" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-9173bb31-b21e-4805-95f9-708508353044" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Deleting offline snapshot 9173bb31-b21e-4805-95f9-708508353044 of volume b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] snapshot_file for this snap is: volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a444f4-41e3-4ad1-9e85-9a9374f2d6e4]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:48 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:49 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 Sep 28 18:38:49 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:49 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" returned: 0 in 0.449s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:49 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919 Sep 28 18:38:49 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:49 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:49 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0838d5f-627a-4095-ac69-30596a6b0aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-650b2f4d-ca8b-4a07-9148-fa5cb2c65919" released by "delete_volume" :: held 0.811s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7733d48-21f8-41ad-963b-6b50fd0fec01]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Created reservations ['c85855f3-8f80-4fc3-b4a3-c999abd75e8d', '687250ff-89cc-4015-a626-7c3fcb690a00', '646fd283-aefb-4f69-aca4-b3a4995860cb', '6ce379b7-3a9f-400c-969b-336f758ead43'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:49 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa Sep 28 18:38:49 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:49 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:49 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:49 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa" returned: 0 in 0.450s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:49 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.337s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:49 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 Sep 28 18:38:49 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:49 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:38:49 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f570954c-b252-4123-97b2-73fd4c5cd91a tempest-ProjectMemberTests-277818136 None] Lock "cinder-650b2f4d-ca8b-4a07-9148-fa5cb2c65919-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:50 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (b48b6fa5-c5bf-455c-b3eb-0b11343c6db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a63208-2fa6-43aa-9c5d-707561f9dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044" returned: 0 in 0.448s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:50 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044 Sep 28 18:38:50 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a63208-2fa6-43aa-9c5d-707561f9dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672756553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:50Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8597c4a4-fde7-445b-a35f-128de3946d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8597c4a4-fde7-445b-a35f-128de3946d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c065fbe-ec9b-47c9-b4c9-9d44e4aebcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c065fbe-ec9b-47c9-b4c9-9d44e4aebcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f', 'volume_name': 'volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fe7fb0-8f62-4ef5-beba-56c9fe682ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fe7fb0-8f62-4ef5-beba-56c9fe682ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183840a2-27d2-4f43-b4c3-25cc14751aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:50 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Volume 6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f', 'volume_size': 1} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672756553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:50Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Creating volume 6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:50 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:50 devstack sudo[109809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f 1073741824 Sep 28 18:38:50 devstack sudo[109809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:50 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa.9173bb31-b21e-4805-95f9-708508353044" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-9173bb31-b21e-4805-95f9-708508353044" released by "_delete_snapshot" :: held 1.730s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" released by "delete_snapshot" :: held 1.759s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Created reservations ['1711d857-6594-452d-8cf0-983a2797e465', 'f22b2aeb-b45d-433d-a2c2-f70c96913fbc', '61bff45f-d24f-4788-9d4b-2831d8f9b76a', '486716f9-f368-4ccc-a70b-13b01dfacb45'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:50 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Delete snapshot completed successfully. Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-89efd820-4b34-4db0-a8ab-465c94337201 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-9173bb31-b21e-4805-95f9-708508353044-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:50 devstack sudo[109809]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f 1073741824" returned: 0 in 0.514s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:50 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:51 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f Sep 28 18:38:51 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-b0838d5f-627a-4095-ac69-30596a6b0aaa-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "cinder-b0838d5f-627a-4095-ac69-30596a6b0aaa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" acquired by "delete_volume" :: waited 0.021s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4bba3-1dce-4b44-ae4f-642b00fbd98b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:51 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" returned: 0 in 0.345s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183840a2-27d2-4f43-b4c3-25cc14751aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a49075-504f-4d3a-acfa-b3c195a28ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:51 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Volume volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f (6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f): created successfully Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a49075-504f-4d3a-acfa-b3c195a28ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (b48b6fa5-c5bf-455c-b3eb-0b11343c6db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:51 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-10e80971-9098-4cb5-b479-24f197631812 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:38:51 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa Sep 28 18:38:51 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:51 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:51 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa Sep 28 18:38:51 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:51 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-b0838d5f-627a-4095-ac69-30596a6b0aaa" returned: 0 in 0.277s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:51 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-b0838d5f-627a-4095-ac69-30596a6b0aaa" released by "delete_volume" :: held 0.783s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Created reservations ['1cfa86e0-55e9-462b-93f1-dc44e95cdcf3', '9760702f-38a7-4626-83b3-aec6b9b85df3', '74ecdefc-1696-427b-9c02-7955d86d11b3', 'c9d91c2c-835f-4a01-91a3-be4c76246154'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:52 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:52 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:52 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.300s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:52 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Deleted volume successfully. Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-656813f5-8a36-4b62-8993-06470856cfab tempest-ProjectReaderTests-1362777320 None] Lock "cinder-b0838d5f-627a-4095-ac69-30596a6b0aaa-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 0b8a3f1a-0f76-477f-ac14-28d2c8cf658c of volume 6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb17ca-52e7-41a4-9b08-d87e726f768a]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:52 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (30dff207-e9d8-4b85-b38e-3bbd2d3f7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:53 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f Sep 28 18:38:53 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa3b653-6f01-48b0-9e37-bbda8649a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa3b653-6f01-48b0-9e37-bbda8649a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181663211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbb7027-e589-4516-984d-d58516d0dbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:53Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd75279-41bd-4da0-ba2e-fb835a32e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd75279-41bd-4da0-ba2e-fb835a32e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2739d-f757-4d94-b220-0cb05ae4e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2739d-f757-4d94-b220-0cb05ae4e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbb7027-e589-4516-984d-d58516d0dbf6', 'volume_name': 'volume-8bbb7027-e589-4516-984d-d58516d0dbf6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f554e1-1635-4442-b4bc-b52b8fd11956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f554e1-1635-4442-b4bc-b52b8fd11956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f685d1-483d-4f8e-b080-af948f9cbeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:53 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Volume 8bbb7027-e589-4516-984d-d58516d0dbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbb7027-e589-4516-984d-d58516d0dbf6', 'volume_size': 1} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:53 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" returned: 0 in 0.495s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:53 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c 1G Sep 28 18:38:53 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:53 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c 1G" returned: 0 in 0.481s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:53 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:53 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c Sep 28 18:38:53 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:54 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" returned: 0 in 0.322s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:54 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c is being set with open permissions: ugo+rw Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:54 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c Sep 28 18:38:54 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:54 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:54 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info Sep 28 18:38:54 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:54 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:54 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info is being set with open permissions: ugo+rw Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:54 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info Sep 28 18:38:54 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:54 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.info" returned: 0 in 0.273s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181663211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbb7027-e589-4516-984d-d58516d0dbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:53Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Creating volume 8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:54 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:54 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:55 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 1073741824 Sep 28 18:38:55 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-578b5363-6468-4253-9300-8235fafdf718 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:38:55 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 1073741824" returned: 0 in 0.558s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:55 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 Sep 28 18:38:55 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:55 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6" returned: 0 in 0.315s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f685d1-483d-4f8e-b080-af948f9cbeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbb7027-e589-4516-984d-d58516d0dbf6', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf29230-f5b3-42e1-93c5-722b30835624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:55 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Volume volume-8bbb7027-e589-4516-984d-d58516d0dbf6 (8bbb7027-e589-4516-984d-d58516d0dbf6): created successfully Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf29230-f5b3-42e1-93c5-722b30835624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (30dff207-e9d8-4b85-b38e-3bbd2d3f7469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:55 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1d1bc99e-c0d4-4124-b1bd-9849523f4cd4 tempest-ProjectReaderTests-1362777320 None] Created volume successfully. Sep 28 18:38:55 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 0b8a3f1a-0f76-477f-ac14-28d2c8cf658c of volume 6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bd44f-d0dd-43e3-8075-c56a6e8a4b08]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:56 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c Sep 28 18:38:56 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Creating offline snapshot 21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a of volume 8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c723f-bd00-43e9-8eca-3031b641daad]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:56 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 Sep 28 18:38:56 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:56 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" returned: 0 in 0.426s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8e72b-6be3-46b9-93c3-789d072ba610]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:56 devstack sudo[109878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f Sep 28 18:38:56 devstack sudo[109878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:56 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6" returned: 0 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:56 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:56 devstack sudo[109884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a 1G Sep 28 18:38:56 devstack sudo[109884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:57 devstack sudo[109878]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" returned: 0 in 0.484s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:57 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c Sep 28 18:38:57 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:57 devstack sudo[109884]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a 1G" returned: 0 in 0.620s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbb7027-e589-4516-984d-d58516d0dbf6 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:57 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbb7027-e589-4516-984d-d58516d0dbf6 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a Sep 28 18:38:57 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:57 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" returned: 0 in 0.476s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:57 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c Sep 28 18:38:57 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:57 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbb7027-e589-4516-984d-d58516d0dbf6 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" returned: 0 in 0.375s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:57 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a is being set with open permissions: ugo+rw Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:57 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f.0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" returned: 0 in 0.332s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:57 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a Sep 28 18:38:57 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c" released by "_delete_snapshot" :: held 1.887s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:57 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" released by "delete_snapshot" :: held 1.915s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Created reservations ['84391297-1e58-4b0f-89fd-755a7282fdc5', '9a6367aa-734e-4aa6-af9a-d7a4c91bc433', '8e17568d-a36d-40c6-a2bd-b441f6466c29', 'b4d477a7-5327-4bba-8754-849df6a6d8fb'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-19ca374e-bf46-49a3-8751-332da13efd5e tempest-ProjectMemberTests-277818136 None] Lock "cinder-0b8a3f1a-0f76-477f-ac14-28d2c8cf658c-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:58 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" returned: 0 in 0.444s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:58 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info Sep 28 18:38:58 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bbb7b2-1272-4530-8d69-a1a987c89b51]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:58 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f Sep 28 18:38:58 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:58 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info" returned: 0 in 0.312s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:58 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info is being set with open permissions: ugo+rw Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:58 devstack sudo[109914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info Sep 28 18:38:58 devstack sudo[109914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:58 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" returned: 0 in 0.390s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:58 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f Sep 28 18:38:58 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:58 devstack sudo[109914]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.info" returned: 0 in 0.269s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:58 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:58 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-4de36c79-54c5-4291-878c-027e13414289 tempest-ProjectReaderTests-1362777320 None] Create snapshot completed successfully Sep 28 18:38:59 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" returned: 0 in 0.311s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f" released by "delete_volume" :: held 0.773s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Created reservations ['36b5aed2-0b69-4f43-9864-199de3b1aef5', '9c41ae47-4b75-4df4-b477-d5a85d0660d5', '60e1f454-1dfb-4db7-8132-12cc07e47778', 'aa92ee90-9ea6-4b32-adc5-609cb46ca8c5'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Flow 'volume_create_manager' (f1198ef2-3f37-4292-a3a5-46da962d3dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31413748-4373-454a-b67b-a721fbc6aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31413748-4373-454a-b67b-a721fbc6aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1324282985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072a6b0c-9086-4d46-99d2-78640f4419a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda2f884b9964d18b49b0f2e0e0cf30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:59Z,use_quota=True,user_id='39d5c0eabd7a4366a1326266303043e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd484e1d-b25b-4930-81c2-818bc4132f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd484e1d-b25b-4930-81c2-818bc4132f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290945bd-1fa3-465f-8ec1-03aebb578816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290945bd-1fa3-465f-8ec1-03aebb578816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072a6b0c-9086-4d46-99d2-78640f4419a3', 'volume_name': 'volume-072a6b0c-9086-4d46-99d2-78640f4419a3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a9ad00-1e3b-43ba-b244-4671488c55f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a9ad00-1e3b-43ba-b244-4671488c55f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7230ebb-5e47-4f24-96a9-3093c3b3d676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:38:59 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Volume 072a6b0c-9086-4d46-99d2-78640f4419a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072a6b0c-9086-4d46-99d2-78640f4419a3', 'volume_size': 1} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1324282985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072a6b0c-9086-4d46-99d2-78640f4419a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda2f884b9964d18b49b0f2e0e0cf30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:38:59Z,use_quota=True,user_id='39d5c0eabd7a4366a1326266303043e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Creating volume 072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:38:59 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:38:59 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 1073741824 Sep 28 18:38:59 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:59 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:38:59 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:38:59 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.315s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Deleting offline snapshot 21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a of volume 8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] snapshot_file for this snap is: volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:38:59 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749055f-0634-41fc-a205-cbe1cfb96f61]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-6ef28ee7-6e04-49a9-89c6-781852c96ef0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-6032fd2c-d2fd-4f27-8f14-cc35cbb5c82f-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:38:59 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a Sep 28 18:38:59 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:38:59 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 1073741824" returned: 0 in 0.609s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:38:59 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:00 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (36b40026-9ffb-40bf-895d-4810bfcd1214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63866d06-12de-469f-807b-389b699f36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63866d06-12de-469f-807b-389b699f36fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988720042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:00Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1296d745-4875-4c9c-b29d-07401907cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1296d745-4875-4c9c-b29d-07401907cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df882b32-a419-41ec-be6f-8460e005fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df882b32-a419-41ec-be6f-8460e005fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1', 'volume_name': 'volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fe3277-32c2-4381-b2cc-659da0e606b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fe3277-32c2-4381-b2cc-659da0e606b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf67a8ac-305c-4368-bb83-8f0e89db37c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Volume 0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1', 'volume_size': 1} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:00 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:00 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" returned: 0 in 0.485s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bbb7027-e589-4516-984d-d58516d0dbf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:00 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.276s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988720042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:00Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Creating volume 0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:00 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7b8ba-fe51-447e-9c49-964c20e53efc]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 1073741824 Sep 28 18:39:00 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7230ebb-5e47-4f24-96a9-3093c3b3d676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072a6b0c-9086-4d46-99d2-78640f4419a3', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd2d59-2bee-4413-951c-462e0b4fb4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:00 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Volume volume-072a6b0c-9086-4d46-99d2-78640f4419a3 (072a6b0c-9086-4d46-99d2-78640f4419a3): created successfully Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd2d59-2bee-4413-951c-462e0b4fb4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Flow 'volume_create_manager' (f1198ef2-3f37-4292-a3a5-46da962d3dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:00 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-09c77dd9-e8e8-43cd-ada0-97ea63e5858f tempest-SnapshotDependencyTests-376965944 None] Created volume successfully. Sep 28 18:39:00 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 Sep 28 18:39:00 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:00 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.278s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:39:00 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 1073741824" returned: 0 in 0.442s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:00 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a Sep 28 18:39:00 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:00 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 Sep 28 18:39:00 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:01 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf67a8ac-305c-4368-bb83-8f0e89db37c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741e7059-7578-4870-a4da-0f3b38a2bd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Volume volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 (0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1): created successfully Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741e7059-7578-4870-a4da-0f3b38a2bd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (36b40026-9ffb-40bf-895d-4810bfcd1214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-74465b48-3583-4400-9278-2835d784c651 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:39:01 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" returned: 0 in 0.401s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:01 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a Sep 28 18:39:01 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:01 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6.21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a" released by "_delete_snapshot" :: held 1.726s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" released by "delete_snapshot" :: held 1.762s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Created reservations ['cbd8ef27-83f8-49e4-a90d-8d2b1ca2bf8b', 'c2fe27af-fcba-4759-9261-ff0658986326', 'a18525e2-6e6e-4a96-9187-9441f76ec05c', '0b6cf82b-20cf-47e9-9831-ee69e3a2baad'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Delete snapshot completed successfully. Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5308e36c-5c09-424c-b1fc-6e81ea854faa tempest-ProjectReaderTests-1362777320 None] Lock "cinder-21ef512f-04a2-4a7b-8bcc-b9ecdfe1749a-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Creating offline snapshot 5db2a83d-b51e-43f6-a808-f66d010561c0 of volume 072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[65998151-b697-4985-9ff7-db9de267ffb9]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:01 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:01 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-8bbb7027-e589-4516-984d-d58516d0dbf6-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "cinder-8bbb7027-e589-4516-984d-d58516d0dbf6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" acquired by "delete_volume" :: waited 0.022s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef27ea1-4c09-4dcb-8ce9-d464e78f6445]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 Sep 28 18:39:02 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:02 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.461s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 1G Sep 28 18:39:02 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:02 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6" returned: 0 in 0.398s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6 Sep 28 18:39:02 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:02 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 1G" returned: 0 in 0.416s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072a6b0c-9086-4d46-99d2-78640f4419a3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072a6b0c-9086-4d46-99d2-78640f4419a3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:02 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:02 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-8bbb7027-e589-4516-984d-d58516d0dbf6" returned: 0 in 0.258s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-8bbb7027-e589-4516-984d-d58516d0dbf6" released by "delete_volume" :: held 0.728s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Created reservations ['5cd558cc-fe5b-451f-841d-9cb2e7470dc0', '8978de33-a6db-4be3-ab61-297f123a7c49', '42683c4a-6965-494c-81a8-5b2942312faa', 'c3872a01-4ae9-44eb-8652-95b1bec4d845'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:02 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:02 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072a6b0c-9086-4d46-99d2-78640f4419a3 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.308s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:02 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 is being set with open permissions: ugo+rw Sep 28 18:39:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:02 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:02 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:03 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.286s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Deleted volume successfully. Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-1eef4070-2a3c-4f3b-a068-3997db89aa8c tempest-ProjectReaderTests-1362777320 None] Lock "cinder-8bbb7027-e589-4516-984d-d58516d0dbf6-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:03 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:03 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info Sep 28 18:39:03 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:03 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:03 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info is being set with open permissions: ugo+rw Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:03 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info Sep 28 18:39:03 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (c3955076-302a-41cc-ac4a-7aa49d44fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304be744-1a86-4471-aaee-136b88104a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304be744-1a86-4471-aaee-136b88104a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650002745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0175601d-a8eb-4de0-bc32-dabbea5a4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:03Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3880869-193a-4789-873c-073d7527862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3880869-193a-4789-873c-073d7527862c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b881c0-1dd3-4228-ada6-602634be6de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b881c0-1dd3-4228-ada6-602634be6de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0175601d-a8eb-4de0-bc32-dabbea5a4bbc', 'volume_name': 'volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b0da4-d0f6-416b-868c-28aedb8c52b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b0da4-d0f6-416b-868c-28aedb8c52b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5157590c-10fc-4774-8191-2e216170412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Volume 0175601d-a8eb-4de0-bc32-dabbea5a4bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc', 'volume_size': 1} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:03 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.info" returned: 0 in 0.257s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.349s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 4781dc4b-76cd-4642-bf58-93ac053d5d30 of volume 0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-dcc19b16-815d-4483-87f9-db6a0866ca74 tempest-SnapshotDependencyTests-376965944 None] Create snapshot completed successfully Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b53fe5-751c-4bbc-8f98-4ec906092249]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:03 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 Sep 28 18:39:03 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:04 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" returned: 0 in 0.397s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:04 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 1G Sep 28 18:39:04 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:04 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 1G" returned: 0 in 0.404s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:04 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 Sep 28 18:39:04 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:04 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30" returned: 0 in 0.312s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:04 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 is being set with open permissions: ugo+rw Sep 28 18:39:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:04 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 Sep 28 18:39:04 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:05 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30" returned: 0 in 0.267s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:05 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info Sep 28 18:39:05 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:05 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info" returned: 0 in 0.274s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:05 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info is being set with open permissions: ugo+rw Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:05 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info Sep 28 18:39:05 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Flow 'volume_create_manager' (53ead9f2-1f08-417c-9c15-bfa1077ba8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede577cc-a888-4df6-a548-9312278fe4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede577cc-a888-4df6-a548-9312278fe4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d61ea9-0ba0-495e-b28e-a31dcd921c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda2f884b9964d18b49b0f2e0e0cf30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5db2a83d-b51e-43f6-a808-f66d010561c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:05Z,use_quota=True,user_id='39d5c0eabd7a4366a1326266303043e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af60ce-4600-4b98-9887-a94e93015f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af60ce-4600-4b98-9887-a94e93015f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc176e4-34c6-4a0b-9e6a-859a50c6571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc176e4-34c6-4a0b-9e6a-859a50c6571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1d61ea9-0ba0-495e-b28e-a31dcd921c76', 'volume_name': 'volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76', 'volume_size': 1, 'snapshot_id': '5db2a83d-b51e-43f6-a808-f66d010561c0'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56ba30b-5e48-4a95-81a2-1e2172b24dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56ba30b-5e48-4a95-81a2-1e2172b24dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46de91f0-5daa-471c-9e42-38c418dc352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:05 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Volume d1d61ea9-0ba0-495e-b28e-a31dcd921c76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76', 'volume_size': 1, 'snapshot_id': '5db2a83d-b51e-43f6-a808-f66d010561c0'} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:05 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.info" returned: 0 in 0.285s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650002745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0175601d-a8eb-4de0-bc32-dabbea5a4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:03Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Creating volume 0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:05 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:05 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc 1073741824 Sep 28 18:39:05 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c55a6c72-ec70-4d8c-b00c-12284678bb15 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:39:06 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc 1073741824" returned: 0 in 0.425s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:06 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc Sep 28 18:39:06 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:06 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.919s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" by "_create_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5157590c-10fc-4774-8191-2e216170412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95b5a07-49ca-4033-8997-b1dec1b1fd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Creating volume d1d61ea9-0ba0-495e-b28e-a31dcd921c76 from snapshot 5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" by "_copy_volume_from_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Volume volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc (0175601d-a8eb-4de0-bc32-dabbea5a4bbc): created successfully Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95b5a07-49ca-4033-8997-b1dec1b1fd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (c3955076-302a-41cc-ac4a-7aa49d44fdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] snapshot: 5db2a83d-b51e-43f6-a808-f66d010561c0, volume: d1d61ea9-0ba0-495e-b28e-a31dcd921c76, {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-4781dc4b-76cd-4642-bf58-93ac053d5d30-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:06 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8389d41e-0fe5-4c20-9034-347f7e868e84 tempest-ProjectReaderTests-1362777320 None] Created volume successfully. Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-4781dc4b-76cd-4642-bf58-93ac053d5d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-4781dc4b-76cd-4642-bf58-93ac053d5d30" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e485e-01d0-4760-ab20-55c7023baa77]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-4781dc4b-76cd-4642-bf58-93ac053d5d30" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 4781dc4b-76cd-4642-bf58-93ac053d5d30 of volume 0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[735298b8-2539-477f-ba78-91da9c7ccbd1]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:06 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:06 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:06 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 Sep 28 18:39:06 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:07 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-072a6b0c-9086-4d46-99d2-78640f4419a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d0111b-dbc4-4368-adc6-b1c7714fe821]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:07 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30" returned: 0 in 0.419s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35384a2-5b7f-4f14-9db3-51c274931d50]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:07 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:07 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:07 devstack sudo[110082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 Sep 28 18:39:07 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:07 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.410s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Creating direct copy from snapshot {{(pid=86560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG cinder.utils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Path /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 not found in is_blk_device check {{(pid=86560) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:07 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 Sep 28 18:39:07 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:07 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" returned: 0 in 0.376s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:07 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 Sep 28 18:39:07 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:07 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30" returned: 0 in 0.347s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:07 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30 Sep 28 18:39:07 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:08 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1.4781dc4b-76cd-4642-bf58-93ac053d5d30" returned: 0 in 0.354s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-4781dc4b-76cd-4642-bf58-93ac053d5d30" released by "_delete_snapshot" :: held 1.636s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" released by "delete_snapshot" :: held 1.678s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Created reservations ['95bcffe4-3e39-4b0e-a8dc-2322d4c66a60', '93e3dff3-e9ed-4b47-8ee3-c1a866373e7a', 'f1bb86b3-81f2-4588-8f81-88d59674b9cc', 'e1cfb70f-7ca4-4b9e-bdf5-064d1b9885e9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:08 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-842e10bc-1d05-4058-8854-873703aa52d7 tempest-ProjectMemberTests-277818136 None] Lock "cinder-4781dc4b-76cd-4642-bf58-93ac053d5d30-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "cinder-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" acquired by "delete_volume" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:09 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8753ec-1159-48b1-b4a6-e116dd271c2b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:09 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 Sep 28 18:39:09 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:09 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" returned: 0 in 0.782s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:09 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1 Sep 28 18:39:09 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:10 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" returned: 0 in 0.388s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1" released by "delete_volume" :: held 1.320s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Created reservations ['68c4981e-f652-4abc-9c6f-27bd887dbce9', '786986fb-a3db-476e-a37d-5eae0baa0ad8', '2c6d5919-5b9f-411a-a39c-f87492338992', '41554a43-cbee-448f-86e8-a97ea0dc213b'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:10 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:10 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:11 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.568s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f624a433-b3b0-4de3-be58-7defb7c34297 tempest-ProjectMemberTests-277818136 None] Lock "cinder-0e42da2d-3b8b-4ccb-ab9b-7e072e1123f1-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (7aa6979c-efdb-4984-97f4-1f132376bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4fb4ad-31b0-4303-b5cf-0a4eee240b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4fb4ad-31b0-4303-b5cf-0a4eee240b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575271677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca60f80-52fd-4683-be67-e554e61d00a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:12Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d03e0f0-779d-41a7-ba6b-27434e516bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d03e0f0-779d-41a7-ba6b-27434e516bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88d42e8-3c46-4beb-82fe-8435b26206e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88d42e8-3c46-4beb-82fe-8435b26206e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca60f80-52fd-4683-be67-e554e61d00a1', 'volume_name': 'volume-1ca60f80-52fd-4683-be67-e554e61d00a1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a16d5c2-a73c-43cb-8afe-379837ad21fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a16d5c2-a73c-43cb-8afe-379837ad21fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e246c-0c56-4fa6-ab0b-30facefe634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:11 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Volume 1ca60f80-52fd-4683-be67-e554e61d00a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca60f80-52fd-4683-be67-e554e61d00a1', 'volume_size': 1} Sep 28 18:39:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:13 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" returned: 0 in 6.469s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:13 devstack cinder-volume[86560]: DEBUG cinder.image.image_utils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Image conversion details: src /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 {{(pid=86560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:39:13 devstack cinder-volume[86560]: INFO cinder.image.image_utils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Converted 1024.00 MB image at 158.27 MB/s Sep 28 18:39:13 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 is being set with open permissions: ugo+rw Sep 28 18:39:13 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:13 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 Sep 28 18:39:13 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:14 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" released by "_copy_volume_from_snapshot" :: held 7.688s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" released by "_create_volume_from_snapshot" :: held 7.776s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.809s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.398s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Creating offline snapshot 2c8c81e8-6827-4af9-bedd-7cbe32a851e4 of volume 0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46de91f0-5daa-471c-9e42-38c418dc352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76', 'volume_size': 1, 'snapshot_id': '5db2a83d-b51e-43f6-a808-f66d010561c0'}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66316e5-6edd-4498-b2f0-2a146d0efcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d5e9e-8c78-45a3-b4da-b407adf65778]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:14 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Volume volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 (d1d61ea9-0ba0-495e-b28e-a31dcd921c76): created successfully Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66316e5-6edd-4498-b2f0-2a146d0efcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Flow 'volume_create_manager' (53ead9f2-1f08-417c-9c15-bfa1077ba8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:14 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-674cc059-0f88-401a-9d7e-2ded216d67ef tempest-SnapshotDependencyTests-376965944 None] Created volume successfully. Sep 28 18:39:14 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc Sep 28 18:39:14 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:14 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" returned: 0 in 0.350s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:14 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:14 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 1G Sep 28 18:39:14 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 1G" returned: 0 in 0.384s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 Sep 28 18:39:15 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-5db2a83d-b51e-43f6-a808-f66d010561c0-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:15 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4" returned: 0 in 0.295s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:15 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 is being set with open permissions: ugo+rw Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-5db2a83d-b51e-43f6-a808-f66d010561c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:15 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 Sep 28 18:39:15 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Deleting offline snapshot 5db2a83d-b51e-43f6-a808-f66d010561c0 of volume 072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] snapshot_file for this snap is: volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afc534-c090-41fb-899a-262c53c2fcd3]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack sudo[110147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:15 devstack sudo[110147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4" returned: 0 in 0.260s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info Sep 28 18:39:15 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack sudo[110147]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-072a6b0c-9086-4d46-99d2-78640f4419a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadfdcd-8316-438a-bda0-7e6fd531c09b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info" returned: 0 in 0.262s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:15 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info is being set with open permissions: ugo+rw Sep 28 18:39:15 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:15 devstack sudo[110157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info Sep 28 18:39:15 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:15 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:15 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:16 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.info" returned: 0 in 0.245s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.248s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575271677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca60f80-52fd-4683-be67-e554e61d00a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:12Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Creating volume 1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:16 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:16 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 1073741824 Sep 28 18:39:16 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-bfcd2b44-d4d0-4fe9-8e66-407637dfdf05 tempest-ProjectReaderTests-1362777320 None] Create snapshot completed successfully Sep 28 18:39:16 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.544s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:16 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:16 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:16 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 1073741824" returned: 0 in 0.429s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:16 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 Sep 28 18:39:16 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:16 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.367s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:16 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0 Sep 28 18:39:16 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:16 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e246c-0c56-4fa6-ab0b-30facefe634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca60f80-52fd-4683-be67-e554e61d00a1', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ac01d7-4df9-4ea5-975b-32a5f4356079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:16 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Volume volume-1ca60f80-52fd-4683-be67-e554e61d00a1 (1ca60f80-52fd-4683-be67-e554e61d00a1): created successfully Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ac01d7-4df9-4ea5-975b-32a5f4356079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (7aa6979c-efdb-4984-97f4-1f132376bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:16 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-3c882f61-9feb-4698-bf56-fca9dd8e6d65 tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:39:16 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:16 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3.5db2a83d-b51e-43f6-a808-f66d010561c0" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-5db2a83d-b51e-43f6-a808-f66d010561c0" released by "_delete_snapshot" :: held 1.660s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" released by "delete_snapshot" :: held 1.682s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Created reservations ['4fe623df-ed78-4658-b5f4-f290b4c9fed3', 'd714a641-340b-47e5-9df6-a6a6c4007498', '177e2f2a-eb31-4344-84e2-22bdade6ed53', '2193e16a-f182-4306-bc5f-32121838bdfc'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:17 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Delete snapshot completed successfully. Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-917cd001-17fd-4f04-bb98-0c564aac2f91 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-5db2a83d-b51e-43f6-a808-f66d010561c0-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot b47a9117-d7ed-429c-9dfe-526be78c4bd0 of volume 1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0da6b0-d738-4554-ae3b-eefda909f832]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-2c8c81e8-6827-4af9-bedd-7cbe32a851e4-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-2c8c81e8-6827-4af9-bedd-7cbe32a851e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-2c8c81e8-6827-4af9-bedd-7cbe32a851e4" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-2c8c81e8-6827-4af9-bedd-7cbe32a851e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Deleting offline snapshot 2c8c81e8-6827-4af9-bedd-7cbe32a851e4 of volume 0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] snapshot_file for this snap is: volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:17 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 Sep 28 18:39:17 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e896bf-daba-4191-8bb2-74e2d785c647]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-072a6b0c-9086-4d46-99d2-78640f4419a3-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:17 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 Sep 28 18:39:17 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-072a6b0c-9086-4d46-99d2-78640f4419a3-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be2bf0-c545-4b01-aad3-4e3c9872950c]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:17 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:17 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 1G Sep 28 18:39:17 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:17 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:17 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:17 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4" returned: 0 in 0.394s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6d3e9-02fb-4542-9d0c-e1fcb81474cb]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:17 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:17 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc Sep 28 18:39:17 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3 Sep 28 18:39:18 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 1G" returned: 0 in 0.452s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60f80-52fd-4683-be67-e554e61d00a1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60f80-52fd-4683-be67-e554e61d00a1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 Sep 28 18:39:18 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" returned: 0 in 0.415s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 Sep 28 18:39:18 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-072a6b0c-9086-4d46-99d2-78640f4419a3" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-072a6b0c-9086-4d46-99d2-78640f4419a3" released by "delete_volume" :: held 0.726s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Created reservations ['c0bc89d7-bf30-47f5-8f1c-c1dd7c7bffc7', 'c6d1d17b-fb27-4dc1-bf2a-d9de4c7c63ee', '2a15b502-97ca-4cd0-8835-7bebadc51c9d', '75579dd3-0223-4a25-ae89-2f52159a6c30'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60f80-52fd-4683-be67-e554e61d00a1 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0" returned: 0 in 0.317s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 is being set with open permissions: ugo+rw Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:18 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 Sep 28 18:39:18 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-d1d61ea9-0ba0-495e-b28e-a31dcd921c76-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4" returned: 0 in 0.417s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-d1d61ea9-0ba0-495e-b28e-a31dcd921c76-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:18 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4 Sep 28 18:39:18 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.299s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:18 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Deleted volume successfully. Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" acquired by "delete_volume" :: waited 0.028s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:18 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0" returned: 0 in 0.333s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-9b3f1435-ca80-42a1-b9cf-4c6d3170ad52 tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-072a6b0c-9086-4d46-99d2-78640f4419a3-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d27d3b-5bda-4c1f-917a-01061ed0777b]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:18 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info Sep 28 18:39:18 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:18 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 Sep 28 18:39:18 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:19 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc.2c8c81e8-6827-4af9-bedd-7cbe32a851e4" returned: 0 in 0.314s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-2c8c81e8-6827-4af9-bedd-7cbe32a851e4" released by "_delete_snapshot" :: held 1.675s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" released by "delete_snapshot" :: held 1.697s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Created reservations ['1e5d3d8e-f28e-45d7-bb41-237653ed9b2c', 'e3cac9d2-ada4-4231-bf34-2b508bbd591f', '9e99c20a-f331-446e-8519-ea17eea9454d', '7ed5f6f0-889a-4dad-afbd-a38e5f8f9327'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:19 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info" returned: 0 in 0.289s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:19 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info is being set with open permissions: ugo+rw Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:19 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info Sep 28 18:39:19 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Delete snapshot completed successfully. Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-a2649472-6506-4fb8-bf0e-4540aa4fc793 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-2c8c81e8-6827-4af9-bedd-7cbe32a851e4-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:19 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" returned: 0 in 0.420s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:19 devstack sudo[110239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76 Sep 28 18:39:19 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:19 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.info" returned: 0 in 0.284s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-0175601d-a8eb-4de0-bc32-dabbea5a4bbc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:19 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f62ce9b7-fa76-4755-933e-36d2d0ded288 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-0175601d-a8eb-4de0-bc32-dabbea5a4bbc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:19 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-quobyte-d1d61ea9-0ba0-495e-b28e-a31dcd921c76" released by "delete_volume" :: held 0.755s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cb4bd4-110e-4cb5-ac47-e2aa5f9b38f7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Created reservations ['484d52d6-edf1-4698-b1fb-da3d5719a043', 'f1d4b3b1-9cbd-4383-af20-a7ad1dac8a78', 'b367e2e9-583a-46c5-bcae-bfd5c24854c3', 'a75a30c3-331e-4a16-851e-dc07ae07862f'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:19 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:19 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc Sep 28 18:39:19 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:19 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:19 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:20 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:20 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Deleted volume successfully. Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-ed237b09-4e0d-4579-b30e-89d96748f6aa tempest-SnapshotDependencyTests-376965944 None] Lock "cinder-d1d61ea9-0ba0-495e-b28e-a31dcd921c76-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:20 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" returned: 0 in 0.418s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:20 devstack sudo[110251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc Sep 28 18:39:20 devstack sudo[110251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:20 devstack sudo[110251]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" returned: 0 in 0.245s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-0175601d-a8eb-4de0-bc32-dabbea5a4bbc" released by "delete_volume" :: held 0.747s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Created reservations ['f5166b7b-6fe4-493e-8906-471251f816ba', 'c644bc38-daea-499e-9dcd-477198b73c76', 'e0bfbbc0-8e34-46cc-9d7a-3c1d5bba7f57', 'd1b2ec65-a3b4-458a-8bcc-94a962d3c542'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-b47a9117-d7ed-429c-9dfe-526be78c4bd0-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-b47a9117-d7ed-429c-9dfe-526be78c4bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-b47a9117-d7ed-429c-9dfe-526be78c4bd0" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-b47a9117-d7ed-429c-9dfe-526be78c4bd0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot b47a9117-d7ed-429c-9dfe-526be78c4bd0 of volume 1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab50d9a-c34d-48e4-b6b6-dd725ce76a81]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:20 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:20 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:20 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 Sep 28 18:39:20 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:20 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.357s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:20 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Deleted volume successfully. Sep 28 18:39:20 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7bb6f7dc-67c7-470a-b218-6255db3e3e11 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-0175601d-a8eb-4de0-bc32-dabbea5a4bbc-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:21 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0" returned: 0 in 0.579s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca60f80-52fd-4683-be67-e554e61d00a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92bb90-2cf5-4bd9-a1c3-8b192cdc3c08]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (9b4c8b4b-f551-492d-9be5-e01958456717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1105688-d6ad-4fc3-970d-57221a66bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1105688-d6ad-4fc3-970d-57221a66bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085099315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24917aa6-8807-4cd9-baf6-8e873d41425a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:21Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b85f08-d725-4b04-8b9c-bf36d711299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b85f08-d725-4b04-8b9c-bf36d711299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37adb3ba-e5bc-44a2-a8a6-2a51bb7272e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:21 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37adb3ba-e5bc-44a2-a8a6-2a51bb7272e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24917aa6-8807-4cd9-baf6-8e873d41425a', 'volume_name': 'volume-24917aa6-8807-4cd9-baf6-8e873d41425a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:21 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d565a4e-06df-44d3-be50-37518b2c6196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d565a4e-06df-44d3-be50-37518b2c6196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083aaaac-add6-43bf-94e1-137633995691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:21 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Volume 24917aa6-8807-4cd9-baf6-8e873d41425a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24917aa6-8807-4cd9-baf6-8e873d41425a', 'volume_size': 1} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085099315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24917aa6-8807-4cd9-baf6-8e873d41425a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7993dc1ec4394a37a8257759dcf98a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:21Z,use_quota=True,user_id='9b94a9bc486547108c2a628961ec5744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Creating volume 24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:21 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:21 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a 1073741824 Sep 28 18:39:21 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:21 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1" returned: 0 in 0.472s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:21 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 Sep 28 18:39:21 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:21 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a 1073741824" returned: 0 in 0.569s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:21 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:22 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a Sep 28 18:39:22 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:22 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0" returned: 0 in 0.423s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:22 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0 Sep 28 18:39:22 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:22 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a" returned: 0 in 0.277s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083aaaac-add6-43bf-94e1-137633995691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24917aa6-8807-4cd9-baf6-8e873d41425a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f61d73a-9d00-43de-ba04-24bad4b1e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:22 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Volume volume-24917aa6-8807-4cd9-baf6-8e873d41425a (24917aa6-8807-4cd9-baf6-8e873d41425a): created successfully Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f61d73a-9d00-43de-ba04-24bad4b1e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Flow 'volume_create_manager' (9b4c8b4b-f551-492d-9be5-e01958456717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0391daf8-bb7e-4fb9-b792-0d134305c5d0 tempest-ProjectReaderTests-1362777320 None] Created volume successfully. Sep 28 18:39:22 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1.b47a9117-d7ed-429c-9dfe-526be78c4bd0" returned: 0 in 0.297s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-b47a9117-d7ed-429c-9dfe-526be78c4bd0" released by "_delete_snapshot" :: held 1.897s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" released by "delete_snapshot" :: held 1.925s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Created reservations ['cb79378d-7eed-4812-95ed-cc824ef5ea05', '57517105-f9d2-4919-aab9-d9c2186dc122', 'c7f4fbd3-1861-467b-91a5-d7b6b3f7ef29', '7f6e45b3-139e-4123-937a-5b0c5683cb5c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:22 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0d55f616-081c-4945-9f1e-99065c457b2a tempest-ProjectMemberTests-277818136 None] Lock "cinder-b47a9117-d7ed-429c-9dfe-526be78c4bd0-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-1ca60f80-52fd-4683-be67-e554e61d00a1-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "cinder-1ca60f80-52fd-4683-be67-e554e61d00a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36ef03-4cc3-42ae-90a6-7086dc5d9e32]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:22 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:22 devstack sudo[110286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 Sep 28 18:39:22 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:23 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1" returned: 0 in 0.375s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:23 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1 Sep 28 18:39:23 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:23 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-1ca60f80-52fd-4683-be67-e554e61d00a1" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-1ca60f80-52fd-4683-be67-e554e61d00a1" released by "delete_volume" :: held 0.697s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Created reservations ['1dfc1fe1-a383-4e98-aa09-1af9a8dcb644', '5aa00670-5a75-4c9c-8ea8-9506d412d534', '48d9db07-af10-4fec-9edc-c77cf9399c7d', '00e20874-d5ef-4e47-86be-333b98375200'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Creating offline snapshot 53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b of volume 24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a7c01-5808-40f4-90ba-baa9c9d7c5be]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:23 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:23 devstack sudo[110295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:23 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:23 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a Sep 28 18:39:23 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:24 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:24 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.453s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:24 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a" returned: 0 in 0.543s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d53d6ef8-998a-474d-aa34-daeec5ed69de tempest-ProjectMemberTests-277818136 None] Lock "cinder-1ca60f80-52fd-4683-be67-e554e61d00a1-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:24 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b 1G Sep 28 18:39:24 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (fea3caf6-b38c-4f77-9daf-218f9988ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c065ee89-6324-485f-b20d-2c64576a6c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c065ee89-6324-485f-b20d-2c64576a6c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445660413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44262721-0c6e-48a9-943b-0add08cf491a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:24Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7193038-9813-4d71-aea1-d4d62cfcccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7193038-9813-4d71-aea1-d4d62cfcccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0528e365-36b5-4ccb-9981-839869bceb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0528e365-36b5-4ccb-9981-839869bceb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44262721-0c6e-48a9-943b-0add08cf491a', 'volume_name': 'volume-44262721-0c6e-48a9-943b-0add08cf491a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d854e347-cf7f-4efb-b028-d76910094d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d854e347-cf7f-4efb-b028-d76910094d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae17e90-8db1-43a8-8c68-14a971ff4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:24 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Volume 44262721-0c6e-48a9-943b-0add08cf491a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44262721-0c6e-48a9-943b-0add08cf491a', 'volume_size': 1} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:24 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b 1G" returned: 0 in 0.493s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:24 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917aa6-8807-4cd9-baf6-8e873d41425a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:24 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917aa6-8807-4cd9-baf6-8e873d41425a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b Sep 28 18:39:24 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:25 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917aa6-8807-4cd9-baf6-8e873d41425a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" returned: 0 in 0.374s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b is being set with open permissions: ugo+rw Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:25 devstack sudo[110314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b Sep 28 18:39:25 devstack sudo[110314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:25 devstack sudo[110314]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" returned: 0 in 0.301s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:25 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info Sep 28 18:39:25 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:25 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info" returned: 0 in 0.271s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:25 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info is being set with open permissions: ugo+rw Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:25 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info Sep 28 18:39:25 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:25 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.info" returned: 0 in 0.256s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445660413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44262721-0c6e-48a9-943b-0add08cf491a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:24Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Creating volume 44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:25 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:25 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:25 devstack sudo[110323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a 1073741824 Sep 28 18:39:25 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:25 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-b3cac824-2459-4e86-bb7f-59cc7aafc66c tempest-ProjectReaderTests-1362777320 None] Create snapshot completed successfully Sep 28 18:39:26 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a 1073741824" returned: 0 in 0.436s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=227,cinder:SELECT=161,cinder:INSERT=60,cinder:DELETE=24 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:26 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a Sep 28 18:39:26 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:26 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a" returned: 0 in 0.290s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae17e90-8db1-43a8-8c68-14a971ff4149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44262721-0c6e-48a9-943b-0add08cf491a', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4fee8b-29d8-4b5e-93ab-9e8471d85a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:26 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Volume volume-44262721-0c6e-48a9-943b-0add08cf491a (44262721-0c6e-48a9-943b-0add08cf491a): created successfully Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4fee8b-29d8-4b5e-93ab-9e8471d85a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (fea3caf6-b38c-4f77-9daf-218f9988ca03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:26 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5bd2138b-83da-49d5-b613-f0b7aebfabfb tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Deleting offline snapshot 53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b of volume 24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] snapshot_file for this snap is: volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b5ba65-ca3f-4b50-b52f-52441fd18edd]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:26 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:26 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b Sep 28 18:39:27 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:27 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" returned: 0 in 0.373s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24917aa6-8807-4cd9-baf6-8e873d41425a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682f75d-93ed-4331-9c2c-cc463ee340b0]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:27 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a Sep 28 18:39:27 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:27 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:27 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b Sep 28 18:39:27 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=221,cinder:SELECT=183,cinder:DELETE=15,cinder:INSERT=58 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Creating offline snapshot 15ee5de0-11a3-4de7-a57c-6088ee027c6c of volume 44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e4d8b0-c0ab-4a5e-b5da-c466c7eb64be]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:27 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:28 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" returned: 0 in 0.409s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:28 devstack sudo[110348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a Sep 28 18:39:28 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:28 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b Sep 28 18:39:28 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:28 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a.53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:28 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a" returned: 0 in 0.428s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b" released by "_delete_snapshot" :: held 1.594s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" released by "delete_snapshot" :: held 1.625s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:28 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c 1G Sep 28 18:39:28 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Created reservations ['41329bf7-a3df-4e85-9a62-d23d3c096b58', '4c2b6526-fea8-4885-a61e-ef597cdf0a30', '1eb056c7-e878-467a-829d-f5d0de5079d6', 'd0494d0f-88ae-4844-9408-568319502e13'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:28 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Delete snapshot completed successfully. Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-d18b7113-9e9c-4670-9ed4-077ffa146dd3 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-53bdb2e9-abfc-47c7-9023-b2aaf1d1ef1b-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:28 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c 1G" returned: 0 in 0.422s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44262721-0c6e-48a9-943b-0add08cf491a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:28 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44262721-0c6e-48a9-943b-0add08cf491a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c Sep 28 18:39:28 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:28 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-24917aa6-8807-4cd9-baf6-8e873d41425a-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-24917aa6-8807-4cd9-baf6-8e873d41425a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" acquired by "delete_volume" :: waited 0.014s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeafa1b-8c0f-49be-b52d-2db89d2d8db7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:29 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44262721-0c6e-48a9-943b-0add08cf491a -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c" returned: 0 in 0.320s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:29 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c is being set with open permissions: ugo+rw Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:29 devstack sudo[110369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c Sep 28 18:39:29 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:29 devstack sudo[110368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a Sep 28 18:39:29 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:29 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:29 devstack sudo[110376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info Sep 28 18:39:29 devstack sudo[110376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:29 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a" returned: 0 in 0.435s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:29 devstack sudo[110378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a Sep 28 18:39:29 devstack sudo[110378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:29 devstack sudo[110376]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info" returned: 0 in 0.306s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:29 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info is being set with open permissions: ugo+rw Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:29 devstack sudo[110381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info Sep 28 18:39:29 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:29 devstack sudo[110378]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-24917aa6-8807-4cd9-baf6-8e873d41425a" returned: 0 in 0.313s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-quobyte-24917aa6-8807-4cd9-baf6-8e873d41425a" released by "delete_volume" :: held 0.817s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:29 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Created reservations ['4c6fc6e6-89bc-4891-bfef-64f938010017', 'aa424a3f-01b3-490f-890a-c553dd01fbcd', '752de835-eadd-4490-89f0-8b6b4fbc3a45', '6bc12aac-2ae2-4b65-a93d-eeb326425dd8'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:30 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.info" returned: 0 in 0.292s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:30 devstack sudo[110385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:30 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-596401b2-b37c-4a83-b3bf-20d686d4cd93 tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:39:30 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.293s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:30 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Deleted volume successfully. Sep 28 18:39:30 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-03a1b055-4a5f-44e5-b52c-4aea9121b3d4 tempest-ProjectReaderTests-1362777320 None] Lock "cinder-24917aa6-8807-4cd9-baf6-8e873d41425a-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-15ee5de0-11a3-4de7-a57c-6088ee027c6c-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-15ee5de0-11a3-4de7-a57c-6088ee027c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-15ee5de0-11a3-4de7-a57c-6088ee027c6c" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-15ee5de0-11a3-4de7-a57c-6088ee027c6c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot 15ee5de0-11a3-4de7-a57c-6088ee027c6c of volume 44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[870bd588-4302-4e36-881e-d9a8669bb571]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:31 devstack sudo[110389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c Sep 28 18:39:31 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:31 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c" returned: 0 in 0.430s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44262721-0c6e-48a9-943b-0add08cf491a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4284dc5-2e27-4f12-90d7-003cd12a8c95]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:31 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:31 devstack sudo[110394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a Sep 28 18:39:31 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:32 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a" returned: 0 in 0.443s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:32 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c Sep 28 18:39:32 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:32 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c" returned: 0 in 0.411s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:32 devstack sudo[110404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c Sep 28 18:39:32 devstack sudo[110404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:32 devstack sudo[110404]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a.15ee5de0-11a3-4de7-a57c-6088ee027c6c" returned: 0 in 0.275s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-15ee5de0-11a3-4de7-a57c-6088ee027c6c" released by "_delete_snapshot" :: held 1.693s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" released by "delete_snapshot" :: held 1.718s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:32 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Created reservations ['f0fb2001-772e-471a-80b1-ad7332182eb3', '637599d6-8de3-49da-83d9-9a7cd347d79f', 'd194fa12-b46f-47e6-b16b-22604284906b', '6132e60b-15e6-4cd4-a626-4a4eceee4cbf'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:33 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-c7c1e0d2-eef2-409f-b415-5af2a0a0e003 tempest-ProjectMemberTests-277818136 None] Lock "cinder-15ee5de0-11a3-4de7-a57c-6088ee027c6c-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-44262721-0c6e-48a9-943b-0add08cf491a-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "cinder-44262721-0c6e-48a9-943b-0add08cf491a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684d68a-426b-42bd-b0aa-1c13d8ad1586]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:33 devstack sudo[110407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a Sep 28 18:39:33 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:33 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a" returned: 0 in 0.374s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:33 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:33 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a Sep 28 18:39:33 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:34 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-44262721-0c6e-48a9-943b-0add08cf491a" returned: 0 in 0.268s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-44262721-0c6e-48a9-943b-0add08cf491a" released by "delete_volume" :: held 0.716s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Created reservations ['b48b1024-eed8-474e-91a2-7e56a9cc7540', '0ab8c9b3-1f73-4ce3-a3fd-5e9d513aaab7', '454aa0a1-ecd4-4bc3-ba3c-15362ce75245', '5bea0a60-c284-4d74-ac35-f1d60f173403'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:34 devstack sudo[110415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:34 devstack sudo[110415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:34 devstack sudo[110415]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.265s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:34 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:39:34 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-5122d516-dd8d-49b7-85cb-1658ba04b375 tempest-ProjectMemberTests-277818136 None] Lock "cinder-44262721-0c6e-48a9-943b-0add08cf491a-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (aff98afd-0440-4427-89d6-6d0003aa7e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bd2765-ccd4-4133-a8bd-bafb8a0706e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bd2765-ccd4-4133-a8bd-bafb8a0706e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450970085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fd8e80-8890-491d-b2fe-38d022493628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:35Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf16efb-06ad-4fd8-b03f-31a7b8771d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf16efb-06ad-4fd8-b03f-31a7b8771d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2e5ec8-3081-4c5e-94b0-404ee765c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2e5ec8-3081-4c5e-94b0-404ee765c09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fd8e80-8890-491d-b2fe-38d022493628', 'volume_name': 'volume-a8fd8e80-8890-491d-b2fe-38d022493628', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc111dc-3067-46a6-ae66-1c375a9fa9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc111dc-3067-46a6-ae66-1c375a9fa9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d06239e-c7b9-402a-a12f-529779b064c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:35 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Volume a8fd8e80-8890-491d-b2fe-38d022493628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fd8e80-8890-491d-b2fe-38d022493628', 'volume_size': 1} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450970085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fd8e80-8890-491d-b2fe-38d022493628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05203870ec4bc9bbd0374f0d5dacc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:39:35Z,use_quota=True,user_id='92d25ef473ef422dab9105522d1e4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Creating volume a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:39:35 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:35 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 1073741824 Sep 28 18:39:35 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:35 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 1073741824" returned: 0 in 0.414s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:35 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 Sep 28 18:39:35 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:35 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:35 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:39:36 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d06239e-c7b9-402a-a12f-529779b064c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fd8e80-8890-491d-b2fe-38d022493628', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a63e2b-e15e-4000-b7d7-6c3fb0fc3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:39:36 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Volume volume-a8fd8e80-8890-491d-b2fe-38d022493628 (a8fd8e80-8890-491d-b2fe-38d022493628): created successfully Sep 28 18:39:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a63e2b-e15e-4000-b7d7-6c3fb0fc3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:39:36 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Flow 'volume_create_manager' (aff98afd-0440-4427-89d6-6d0003aa7e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:39:36 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-cb7bf958-2788-4db7-a7dd-fc5089aacade tempest-ProjectMemberTests-277818136 None] Created volume successfully. Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Creating offline snapshot b4acbb50-138f-4e49-a089-59f8861876d2 of volume a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c25ccd8-9bec-41d9-a3b6-a39993eab485]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:37 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 Sep 28 18:39:37 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:37 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628" returned: 0 in 0.363s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:37 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 1G {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:37 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 1G Sep 28 18:39:37 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:38 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 1G" returned: 0 in 0.474s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fd8e80-8890-491d-b2fe-38d022493628 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:38 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fd8e80-8890-491d-b2fe-38d022493628 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 Sep 28 18:39:38 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:38 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fd8e80-8890-491d-b2fe-38d022493628 -F qcow2 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2" returned: 0 in 0.310s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:38 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 is being set with open permissions: ugo+rw Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:38 devstack sudo[110444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 Sep 28 18:39:38 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:38 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2" returned: 0 in 0.269s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:38 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info Sep 28 18:39:38 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:38 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info" returned: 0 in 0.260s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:38 devstack cinder-volume[86560]: WARNING cinder.volume.drivers.remotefs [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info is being set with open permissions: ugo+rw Sep 28 18:39:38 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:39 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info Sep 28 18:39:39 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:39 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.info" returned: 0 in 0.246s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:39 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:39 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-01629729-0b39-4548-9aeb-eb024aa0febb tempest-ProjectMemberTests-277818136 None] Create snapshot completed successfully Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-b4acbb50-138f-4e49-a089-59f8861876d2-delete_snapshot" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-b4acbb50-138f-4e49-a089-59f8861876d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" by "delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-b4acbb50-138f-4e49-a089-59f8861876d2" by "_delete_snapshot" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-b4acbb50-138f-4e49-a089-59f8861876d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Deleting offline snapshot b4acbb50-138f-4e49-a089-59f8861876d2 of volume a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] snapshot_file for this snap is: volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764b405-ee6b-4cee-82db-fbcbb385a3ee]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:40 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:40 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 Sep 28 18:39:40 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:41 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2" returned: 0 in 0.427s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8fd8e80-8890-491d-b2fe-38d022493628(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b10f5-286e-461f-a279-97f220a70497]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:41 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 Sep 28 18:39:41 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:41 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628" returned: 0 in 0.378s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:41 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 Sep 28 18:39:41 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:41 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2" returned: 0 in 0.366s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:41 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:41 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2 Sep 28 18:39:41 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:42 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628.b4acbb50-138f-4e49-a089-59f8861876d2" returned: 0 in 0.256s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-b4acbb50-138f-4e49-a089-59f8861876d2" released by "_delete_snapshot" :: held 1.550s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" released by "delete_snapshot" :: held 1.574s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Created reservations ['58b2f380-f0de-4f52-97ed-2a3ea7b8ae92', 'ce21fb21-0cf6-41a4-9c55-6d10a1da9aa6', 'd5b5a1c1-f068-4025-a0ad-fc067c396340', 'f224ae0b-4c84-4e84-8d3b-550b42a42ccb'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:42 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Delete snapshot completed successfully. Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-f7176a98-ea8c-4b79-be66-80f183587bb0 tempest-ProjectMemberTests-277818136 None] Lock "cinder-b4acbb50-138f-4e49-a089-59f8861876d2-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-a8fd8e80-8890-491d-b2fe-38d022493628-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "cinder-a8fd8e80-8890-491d-b2fe-38d022493628-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Acquiring lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" acquired by "delete_volume" :: waited 0.013s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[95869706-ba15-4b75-8492-e251752b4006]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:39:42 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:42 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 Sep 28 18:39:42 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:43 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628" returned: 0 in 0.352s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:43 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628 Sep 28 18:39:43 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:43 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-a8fd8e80-8890-491d-b2fe-38d022493628" returned: 0 in 0.246s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "cinder-quobyte-a8fd8e80-8890-491d-b2fe-38d022493628" released by "delete_volume" :: held 0.655s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Created reservations ['6703a0c4-dfd4-4aee-a8d7-6446ff33f61b', '12f459c9-2668-4366-8fd0-eb5cc089d320', '8c8993eb-e49a-48b4-9ff7-b8a9ea9bd623', '74684841-2642-46f9-8f9a-f6e43f166fb9'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:39:43 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:39:43 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:39:43 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.272s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:39:43 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Deleted volume successfully. Sep 28 18:39:43 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-7aeafd78-d1e3-4020-b37a-842182b1334d tempest-ProjectMemberTests-277818136 None] Lock "cinder-a8fd8e80-8890-491d-b2fe-38d022493628-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:39:53 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=29,cinder:INSERT=15,cinder:UPDATE=50,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:39:53 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=46,cinder:SELECT=42,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:00 devstack sudo[110497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:40:00 devstack sudo[110497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:00 devstack sudo[110497]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.260s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG oslo_service.periodic_task [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] Running periodic task VolumeManager._thread_info {{(pid=86560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread count: 29 {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-13f23544-1c43-4159-b732-7a9357a6b4f6 None None] thread info: [<_MainThread(MainThread, started 130837790916736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:40:00 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (e42b6dbc-4625-4d7b-bac0-df8b12c0c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd736ec-ea67-490b-acc9-0dbe54d8de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd736ec-ea67-490b-acc9-0dbe54d8de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033570377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feac205-4d2d-4607-90d4-2c24e91c20dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:01Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268c71b3-965c-4bb9-9be4-8cfb05e21690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268c71b3-965c-4bb9-9be4-8cfb05e21690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2248d6-80b2-43bb-befd-c4ce50985c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2248d6-80b2-43bb-befd-c4ce50985c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7feac205-4d2d-4607-90d4-2c24e91c20dc', 'volume_name': 'volume-7feac205-4d2d-4607-90d4-2c24e91c20dc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d29dd9-253e-4c68-9a8e-973ff1b0029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d29dd9-253e-4c68-9a8e-973ff1b0029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae63351f-d8d7-4486-9a63-2ebde96164c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Volume 7feac205-4d2d-4607-90d4-2c24e91c20dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7feac205-4d2d-4607-90d4-2c24e91c20dc', 'volume_size': 1} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033570377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feac205-4d2d-4607-90d4-2c24e91c20dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:01Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Creating volume 7feac205-4d2d-4607-90d4-2c24e91c20dc {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:40:01 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:01 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc 1073741824 Sep 28 18:40:01 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:01 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc 1073741824" returned: 0 in 0.402s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:01 devstack sudo[110506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc Sep 28 18:40:01 devstack sudo[110506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:01 devstack sudo[110506]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc" returned: 0 in 0.244s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae63351f-d8d7-4486-9a63-2ebde96164c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7feac205-4d2d-4607-90d4-2c24e91c20dc', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023de5cb-23b1-48a0-9282-efdab6b280f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:01 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Volume volume-7feac205-4d2d-4607-90d4-2c24e91c20dc (7feac205-4d2d-4607-90d4-2c24e91c20dc): created successfully Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023de5cb-23b1-48a0-9282-efdab6b280f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:01 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (e42b6dbc-4625-4d7b-bac0-df8b12c0c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:01 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-36aa9558-a1b3-448f-8a15-f32722674cae tempest-ProjectReaderTests-103580927 None] Created volume successfully. Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-7feac205-4d2d-4607-90d4-2c24e91c20dc-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "cinder-7feac205-4d2d-4607-90d4-2c24e91c20dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-quobyte-7feac205-4d2d-4607-90d4-2c24e91c20dc" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-7feac205-4d2d-4607-90d4-2c24e91c20dc" acquired by "delete_volume" :: waited 0.016s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef91ccd8-8208-47b9-b55e-f1f46b66b9e7]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:02 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc Sep 28 18:40:02 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:02 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc" returned: 0 in 0.348s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:02 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc Sep 28 18:40:02 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:02 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-7feac205-4d2d-4607-90d4-2c24e91c20dc" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:02 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-7feac205-4d2d-4607-90d4-2c24e91c20dc" released by "delete_volume" :: held 0.633s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Created reservations ['a65cf973-5146-4c48-b16e-dea945069b78', 'a305a388-bbba-4fb9-9b59-10ad9bd59f0e', '9c5873d8-be11-4d7f-a51d-2018bd75b29b', '27097b51-6d4f-497b-bfc3-7651ef28d402'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:03 devstack sudo[110523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:40:03 devstack sudo[110523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:03 devstack sudo[110523]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.253s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:40:03 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Deleted volume successfully. Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-93ee6594-f4a5-483d-99b3-ee31f10d283f tempest-ProjectReaderTests-103580927 None] Lock "cinder-7feac205-4d2d-4607-90d4-2c24e91c20dc-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (29dff822-fb61-48b4-bb1a-ffb7c7869a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c822b342-f130-45a8-bfd7-bf9091259502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c822b342-f130-45a8-bfd7-bf9091259502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402395395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823fed0-d373-42fa-b713-ec53b93ea6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:04Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f888e3-c827-4899-ae30-734e183eff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f888e3-c827-4899-ae30-734e183eff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae04fc7-18d8-48aa-8640-7a0cbb4f8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae04fc7-18d8-48aa-8640-7a0cbb4f8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4823fed0-d373-42fa-b713-ec53b93ea6ab', 'volume_name': 'volume-4823fed0-d373-42fa-b713-ec53b93ea6ab', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a853f1b-57ae-445e-be77-cf3efd4f1d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a853f1b-57ae-445e-be77-cf3efd4f1d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059572c-acec-4e65-a73e-75e5a4728700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:03 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Volume 4823fed0-d373-42fa-b713-ec53b93ea6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4823fed0-d373-42fa-b713-ec53b93ea6ab', 'volume_size': 1} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402395395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823fed0-d373-42fa-b713-ec53b93ea6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:04Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Creating volume 4823fed0-d373-42fa-b713-ec53b93ea6ab {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:40:03 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:40:03 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:03 devstack sudo[110526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab 1073741824 Sep 28 18:40:03 devstack sudo[110526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:04 devstack sudo[110526]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab 1073741824" returned: 0 in 0.431s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:04 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab Sep 28 18:40:04 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:04 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab" returned: 0 in 0.254s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059572c-acec-4e65-a73e-75e5a4728700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4823fed0-d373-42fa-b713-ec53b93ea6ab', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774a73cb-2d58-4f4d-aa2a-3fb1aea7e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:04 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Volume volume-4823fed0-d373-42fa-b713-ec53b93ea6ab (4823fed0-d373-42fa-b713-ec53b93ea6ab): created successfully Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774a73cb-2d58-4f4d-aa2a-3fb1aea7e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (29dff822-fb61-48b4-bb1a-ffb7c7869a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:04 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6376c84f-9096-4662-8e09-e6f5733af9ca tempest-ProjectReaderTests-103580927 None] Created volume successfully. Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-4823fed0-d373-42fa-b713-ec53b93ea6ab-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "cinder-4823fed0-d373-42fa-b713-ec53b93ea6ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-quobyte-4823fed0-d373-42fa-b713-ec53b93ea6ab" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-4823fed0-d373-42fa-b713-ec53b93ea6ab" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74b74f-fbc1-4ac2-aceb-bff796817e7f]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:40:04 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:05 devstack sudo[110534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab Sep 28 18:40:05 devstack sudo[110534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:05 devstack sudo[110534]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab" returned: 0 in 0.386s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:05 devstack sudo[110539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab Sep 28 18:40:05 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:05 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-4823fed0-d373-42fa-b713-ec53b93ea6ab" returned: 0 in 0.261s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-4823fed0-d373-42fa-b713-ec53b93ea6ab" released by "delete_volume" :: held 0.693s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Created reservations ['0be9d8af-2794-4cc6-a7ec-e53dfb014897', '910574ad-0010-4616-be18-6f25ab26e4e0', '52a171bb-280d-4f99-9ff5-8e6d50a69d3d', '17f0f2d2-c138-44fa-a6a4-9e3573c2c215'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:05 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:40:05 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:05 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.252s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:05 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:40:05 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Deleted volume successfully. Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-425216b6-15de-4cae-9cc6-9389c3e1e2ec tempest-ProjectReaderTests-103580927 None] Lock "cinder-4823fed0-d373-42fa-b713-ec53b93ea6ab-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (bb4cc7a3-704e-42c4-a543-929654401236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88cd25-5a81-426e-9725-38311551936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88cd25-5a81-426e-9725-38311551936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046367149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279a51ba-60aa-406b-8b9c-9c2a6c0f2756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:06Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829e8df5-5fb4-4174-b892-e6df36e938cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829e8df5-5fb4-4174-b892-e6df36e938cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5057d2-75b0-4f7c-8548-0f346fc175ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5057d2-75b0-4f7c-8548-0f346fc175ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279a51ba-60aa-406b-8b9c-9c2a6c0f2756', 'volume_name': 'volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1251bc9-0a85-4593-968c-07a060d10e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1251bc9-0a85-4593-968c-07a060d10e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf1391-ab96-44ae-b103-6068fc34a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:06 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Volume 279a51ba-60aa-406b-8b9c-9c2a6c0f2756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756', 'volume_size': 1} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046367149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279a51ba-60aa-406b-8b9c-9c2a6c0f2756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:06Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Creating volume 279a51ba-60aa-406b-8b9c-9c2a6c0f2756 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:40:06 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:40:06 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:06 devstack sudo[110582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 1073741824 Sep 28 18:40:06 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:07 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 1073741824" returned: 0 in 0.404s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:07 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 Sep 28 18:40:07 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:07 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" returned: 0 in 0.256s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf1391-ab96-44ae-b103-6068fc34a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea67d90c-0726-4217-9cf3-450c189dfef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:07 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Volume volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 (279a51ba-60aa-406b-8b9c-9c2a6c0f2756): created successfully Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea67d90c-0726-4217-9cf3-450c189dfef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:07 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (bb4cc7a3-704e-42c4-a543-929654401236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:07 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-8e7abff0-2e28-4e9c-b091-8b141e33cb1b tempest-ProjectReaderTests-103580927 None] Created volume successfully. Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-279a51ba-60aa-406b-8b9c-9c2a6c0f2756-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "cinder-279a51ba-60aa-406b-8b9c-9c2a6c0f2756-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-quobyte-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" acquired by "delete_volume" :: waited 0.013s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3d59f-d7b5-4ced-b0f2-2b85f811ba6d]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:40:08 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:08 devstack sudo[110591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 Sep 28 18:40:08 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:09 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" returned: 0 in 0.377s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:09 devstack sudo[110596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756 Sep 28 18:40:09 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:09 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" returned: 0 in 0.246s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-279a51ba-60aa-406b-8b9c-9c2a6c0f2756" released by "delete_volume" :: held 0.666s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Created reservations ['abfdab23-822b-4d18-999a-bf4ca6ed050a', '0d8fd571-41c2-4b25-a6bf-97c6e0de297e', 'db0909a9-9f5d-4fcb-b1df-f2768b05af71', '865c848f-ea2a-4d82-82c1-394cca5b5671'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:09 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:40:09 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:09 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.248s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:40:09 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Deleted volume successfully. Sep 28 18:40:09 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-56da386f-d8d5-46dc-99c2-51067af65904 tempest-ProjectReaderTests-103580927 None] Lock "cinder-279a51ba-60aa-406b-8b9c-9c2a6c0f2756-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (81c0b6f6-7a99-450b-98a8-f4f602fba2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf17bda-3593-495c-bca0-cdf1dfccfdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf17bda-3593-495c-bca0-cdf1dfccfdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041647798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:10Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49e8b7-3104-429c-9963-3db9f24802c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49e8b7-3104-429c-9963-3db9f24802c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77c957e-b0e7-4649-be4f-b21f3ad9b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77c957e-b0e7-4649-be4f-b21f3ad9b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7', 'volume_name': 'volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434cda76-5248-42a9-91ad-192e8cc6151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434cda76-5248-42a9-91ad-192e8cc6151a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd4dc2d-1fd1-415c-8b0e-4a4c882f954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:10 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Volume e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7', 'volume_size': 1} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041647798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b22567f66c42dbafdf9eb84897e3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:40:10Z,use_quota=True,user_id='75a25834f716484a82f397f71b1a7e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e51b7f6-0968-4b03-9aa1-ce2c4207edc1),volume_type_id=5e51b7f6-0968-4b03-9aa1-ce2c4207edc1)}" {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.remotefs [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Creating volume e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 {{(pid=86560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Selected osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 as target Quobyte volume. {{(pid=86560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:40:10 devstack cinder-volume[86560]: INFO cinder.volume.drivers.remotefs [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] casted to osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0 Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 1073741824 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:10 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 1073741824 Sep 28 18:40:10 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:10 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 1073741824" returned: 0 in 0.437s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:10 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:10 devstack sudo[110607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 Sep 28 18:40:10 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:11 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" returned: 0 in 0.247s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'} {{(pid=86560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd4dc2d-1fd1-415c-8b0e-4a4c882f954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7', 'volume_size': 1}' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff22854-fe32-4399-a670-1b299f89920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:40:11 devstack cinder-volume[86560]: INFO cinder.volume.flows.manager.create_volume [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Volume volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 (e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7): created successfully Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff22854-fe32-4399-a670-1b299f89920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Flow 'volume_create_manager' (81c0b6f6-7a99-450b-98a8-f4f602fba2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:40:11 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-6be13295-6734-4354-83c4-bebdb7593faa tempest-ProjectReaderTests-103580927 None] Created volume successfully. Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7-delete_volume" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "cinder-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Acquiring lock "cinder-quobyte-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" by "delete_volume" {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" acquired by "delete_volume" :: waited 0.013s {{(pid=86560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c8d92-a38f-42d5-a20d-86b98df41442]: (4, 'qcow2') {{(pid=88316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:11 devstack sudo[110610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 Sep 28 18:40:11 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:11 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" returned: 0 in 0.356s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:11 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7 Sep 28 18:40:11 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:11 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812/volume-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" returned: 0 in 0.239s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:11 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "cinder-quobyte-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7" released by "delete_volume" :: held 0.634s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG cinder.quota [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Created reservations ['5dc30e7b-44bf-4093-8f4c-8915bb0d3cdf', 'f57cf114-ace2-4203-a3f8-3059f85a56d5', '751f1a74-c8a0-4e1a-ae27-a04f17cd56ca', '9165cfc5-141c-4383-8c03-066c7b67b35c'] {{(pid=86560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0': None} {{(pid=86560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG cinder.volume.drivers.quobyte [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa0d8f63-d3fe-4e7f-8761-b796a31166c0'] {{(pid=86560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:40:12 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812 Sep 28 18:40:12 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:40:12 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG oslo_concurrency.processutils [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/76c8215189a52e4b6cc870192e6a9812" returned: 0 in 0.255s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG cinder.manager [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Notifying Schedulers of capabilities ... {{(pid=86560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:40:12 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Deleted volume successfully. Sep 28 18:40:12 devstack cinder-volume[86560]: DEBUG cinder.coordination [None req-0c43b7d3-bbb1-4197-b0bf-4e41947fb534 tempest-ProjectReaderTests-103580927 None] Lock "cinder-e4720eb8-1d0a-43a5-96d3-ad4f89c3e5f7-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:40:22 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:UPDATE=47,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:40:22 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=30,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=7 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}